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CHAPTER  I 
INTRODUCTION 


1  - 1  .  Objectives  and  Summary. 

This  thesis  will  be  essentially  devoted  to  the  development  of  a 
decomposition  method  for  solving  large  linear  programming  problems 
arising  from  N  interconnected  linear  systems.  These  problems,  which 
will  be  referred  to  as  linear  interconnection  problems,  can  be  stated 
as  follows:^ 

(1)  Minimize  Z  =  cx  subject  to  Ax  =  b,  x  _>  0  where  the  coefficient 
matrix  A  has  a  structure  of  the  type 


(2) 


a' 

I 

-I 

I 

-I 

1 

a' 

-I 

I 

I 

-I 

_ 

a' 

-I 

I 

-I 

I 

We  point  out  immediately  that  the  mulstistage  linear  problem 
concerned  with  dynamic  situations  having  a  finite  number  of  time  periods 
is  a  particular  form  of  problem  (1),  whose  coefficient  matrix  has  the 
staircase  structure 


The  notations  adopted  in  this  repoit  are  explained  in  section 
2  of  this  chapter. 
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(3) 


-I 

I 

B 

a' 

12  3 

where  the  matrices  A  ,  A  and  A  might  be  identical. 

Linear  programs  having  a  coefficient  matrix  similar  to  matrix 

(2)  might  represent,  for  instance,  optimization  problems  arising  from 

the  cooperation  of  three  economies  (or  industries)  whose  production 

functions  are  assumed  to  be  linear.  In  such  a  case  the  matrices  a\ 

2  3 

A  and  A  would  represent  input-output  coefficient  matrices  of  econ¬ 
omies  1,  2  and  3  respectively,  whereas  the  connection  matrices  I  and 
-I  would  represent  importation  and  exportation  matrices.  The  objective 
function,  in  this  case,  could  be  thought  of  as  a  common  social  welfare 
function  [32,  p.  47]  which  has  to  be  optimized. 

In  this  report  we  first  develop  two  decomposition  methods  for 

solving  the  special  class  of  linear  interconnection  problems  for  which 
^  12  3 

the  above  matrices  A  ,  A  and  A  are  Leontief  matrices.  Although 
the  solution  methods  for  this  type  of  problem  might  have  a  wide  range 
of  appl  ication  --  notably  to  the  study  of  Leontief  economic  models  and 
sequential  decision  problems  [l6]  --  it  is  not  the  practical  usefulness 
of  these  models  which  motivated  their  extensive  development  in  this 
report,  but  rather  the  fact  that,  as  far  as  mathematical  programming 
is  concerned,  they  have  an  ideal  behavior  which  gives  us  valuable  in¬ 
sight  into  more  complex  problems. 
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In  chapter  II  we  introduce  the  simplest  decomposition  approach 
which  one  might  conjecture  would  work,  i.  e.  ,  a  method  based  on  com¬ 
munication  of  prices  only.  We  refer  to  this  method  as  a  price-com¬ 
munication  decomposition  method.  In  chapter  III,  which  is  the  core  of 
this  study,  we  develop  a  decomposition  method  for  solving  linear  pro¬ 
gramming  problems  of  type  (2)  for  interconnected  Leontief  systems. 

This  method,  which  is  called  decomposition  method  by  square-block 
triangularization,  is  extended  in  chapter  IV  to  general  interconnected 
matrices.  The  essential  ideas  underlying  this  decomposition  method 
are  the  following. 

Given  a  basic  feasible  solution  to  a  linear  program  of  type  (1) 
we  shall  transform  this  problem  into  an  equivalent  linear  program  which 
will  have  a  feasible  basis  in  the  following  square  block  triangular  form 


we  shall  see  that  we  can  find  an  improved  solution  of  this  equivalent 
problem  by  solving,  via  the  simplex  method,  a  smaller  subproblem 
called  the  improvement  subprogram.  If  this  improved  solution  is  not 
optimal,  we  set  up  another  equivalent  problem  which,  in  its  turn,  will 
lead  to  another  improvement  subprogram,  and  so  oh,  tintil  optimality 


is  reached. 
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The  main  features  of  the  two  decomposition  procedures  just 
mentioned  are  the  following: 

(a)  All  the  coefficient  matrices  of  the  improvement  subprograms 
have  the  following  structure: 


where 

A  is  the  submatrix  of  A  corresponding  to  the  i^^  system; 
(for  j  ^  i  only)  is  a  modified  exchange  matrix  of  the  form 


=  I  +  e-* 
m 


1 

1 

X  .  .  . 

.  X 

X  X 

X 

X 

.  .X 

Where  I  is  the  identity  matrix  of  order  m. 
m 

(b)  The  exchange  of  information  which  is  required  between  the 
subprograms  consists  of 

(i)  the  simplex  multipliers  only  for  the  price  communication 
decomposition  algorithm  of  chapter  11; 

(ii)  the  simplex  multipliers  and  the  matrices  for  the  square- 
block  triangularization  decomposition  algorithm  when  ap¬ 


plied  to  Leontief  systems; 


(iii)  the  simplex  multipliers,  the  matrices  0'^  plus  some  ad¬ 
ditional  information  related  to  the  feasibility  of  the  solu¬ 
tions  when  applied  to  general  systems. 

Remark.  At  this  point  it  should  be  mentioned  that  when  the  decomposi¬ 
tion  principle  of  Dantzig  rnd  Wolfe  [9,  ch.  23],  [l4]  and  [15]  is  applied 
to  solve  problem  (1),  its  master  program  behaves  to  some  extent  like 
an  improvement  subprogram  of  the  square  block  triangularization  de¬ 
composition  method,  whereas  its  subproblems  are  rather  similar  to 
those  obtained  by  the  price  communication  decomposition  method. 

(c)  The  decomposition  procedures  considered  in  this  report  are 
symmetric  in  the  sense  that 

(i)  all  subprograms  have  the  same  structure; 

(ii)  the  exchange  of  information  between  the  subprograms  is  the 
same  in  all  directions. 

This  feature  might  be  of  importance  when  a  horizontal  decentralization 
of  the  decision  making  process  becomes  necessary.  By  this  we  mean 
that  no  hierarchy  exists  between  the  interconnected  systems.  For  in¬ 
stance,  problems  concerning  the  cooperation  of  several  independent 
economies  would  certainly  require  this  type  of  decentralization. 

(d)  The  decomposition  methods  are  always  primal  feasible. 

By  this  we  mean  that,  at  any  stage  of  the  decomposition,  basic  feasible 
solutions  to  the  original  problem  as  well  as  the  subproblems  are  known. 
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The  idea  of  taking  advantage  of  the  square  block  triangularity 
of  the  bases  is,  of  course,  not  new.  In  particular,  Dantzig  [ll]  has 
applied  it  to  solve  dynamic  Leontief  systems  with  substitution,  and  has 
even  suggested  an  interesting  decomposition  method  for  solving  multi¬ 
stage  problems  which  is  based  on  artificial  square  block  triangular 
bases,  [lO]  and  [l2].  However,  the  computations  required  by  this 
last  method  appeared  quite  complex,  and  it  seems  that  it  has  not  at¬ 
tracted  much  attention,  especially  since  the  discovery  of  the  decomposi¬ 
tion  principle  of  Dantzig  and  Wolfe  which  promised  much  more  elegant 
solutions  for  these  multistage  problems. 

Then,  in  recent  years,  came  the  development  of  methods  which 
are  basically  variants  of  the  simplex  method  adapted  to  special  struc¬ 
tures  of  large  scale  linear  programming  problems.  All  these  methods 
take  advantage  of  the  observation  that  "the  inverse  of  the  basis  in  the 
simplex  method  serves  no  function  except  as  a  means  for  obtaining  the 
representation  of  the  vector  entering  the  basis  and  for  determining  the 
new  price  vector"  [13,  p.  1  ]  .  Among  these  methods  we  mention  for 
their  approach  the  primal  partitioning  programming  procedure,  Rosen 
[34];  the  pseudo-basic  variable  procedur  e,  Beale  [6];  the  compact  basis 
triangularization  method,  Dantzig  [13];  and  very  recently,  the  dualplex 
method,  Gass  [23]. 
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We  must  also  mention  that  Abadie  [3]  has  shown  that,  under 
certain  conditions,  if  the  decomposition  method  of  Dantzig  and  Wolfe 
is  specialized  to  obtain  basic  solutions  at  each  iteration,  then  it  be¬ 
comes  nothing  else  than  a  variant  of  the  simplex  method  for  which  the 
inverse  of  the  current  basis  is  computed  by  partitioning.  We  believe 
that  this  observation  is  important  because  it  indicates  that,  provided 
an  adequate  exchange  of  information  takes  place,  the  primal  simplex 
method  lends  itself  to  decentralized  computations.  Since  there  is  no 
good  reason  to  think  that  the  simplex  method  which  has  proved  to  be 
very  efficient  for  the  solution  of  small  linear  programs  w'ill  not  be  as 
well  adapted  to  the  solution  of  large  ones,  it  seems  that  efficient  de¬ 
composition  methods  for  solving  the  latter  might  well  be  sought  within 
the  framewoi  k  of  the  simplex  method. 

To  conclude  these  remarks  we  observe  that  the  main  factors 
which  have  to  be  considered  in  the  choice  of  a  decomposition  procedure 
are 

(a)  the  structure  of  the  basis; 

(b)  the  partitioning  imposed  (if  any)  by  the  necessity  of  de¬ 
centralization; 

(d)  the  type  of  exchange  of  information  between  the  subprograms 


which  is  desirable. 
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1-2.  Terminology  and  Notations. 

In  this  report  we  shall  adhere  most  of  the  time  to  the  standard 
terminology  in  mathematical  programming,  for  which  we  refer  to  [9], 
[21  ] ,  [22] ,  and  [26] ,  and  for  the  rest  we  shall  define  the  technical 
terms  and  symbols  as  they  are  introduced.  Therefore,  only  a  few  no- 
tational  remarks  are  in  order  here. 

We  first  give  a  list  of  the  principal  notations  used  in  this  re¬ 
port  to  best  illustrate  the  conventions  we  have  adopted. 

A,  B,  C ,  D,  E,  H ,  P,  Q, R ,  S,  T  denote  exclusively  matrices. 

|a|  denotes  the  determinant  of  the  square  matrix  A. 

th 

A.  .  denotes  the  j  column  vector  of  the  matrix  A. 

J 

A.  =  A.  .  if  no  confusion  is  possible. 

J  } 

A..  denotes  the  i^^  row  vector  of  the  matrix  A. 

1 

A  denotes  the  submatrix  of  the  (m  X  n)  matrix  A  whose 

sJ 

columns  are  (A.) .  ^  where  N  =  {l,2,...,n}. 

J  J 

Ay  denotes  the  set  of  columns  of  A  which  are  not  in  A^ 

Q,  T,  p,  V  normally  denote  scalars. 

b,  c,  d,  x,  t,  w,  y  denote  vectors.  Note  that  no  distinction  is 

made  between  row  and  column  vectors. 

b.  denotes  the  vector  whose  components  are  (b.),  i  c  J, 

J  1 

B  normally  denotes  a  feasible  basis  of  a  linear  program. 

P  always  denotes  the  inverse  of  the  matrix  B. 
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e  =  (1 ,  1 ,  .  ,  .  ,  1 )  denotes  the  m-component  vector  all  of 
m 

whose  components  are  one. 

u.  -  (0,  ...  0,  1 ,  0.  .  .  0)  denotes  the  unit  vector  whose 
1 

th 

i  coordinate  is  one  and  whose  other  coordinates  arc 

zero. 

I  denotes  the  identity  matrix  of  order  m  . 
m 

l\  K  denote  sets  of  positive  integers  (indices). 

M  =  {  1  ,  2,  .  .  .  m}  denotes  the  set  of  positive  integers  from 
1  to  m  . 

N.  =  {  1 ,  2,  .  .  .  n.  }  denotes  the  set  of  positive  integers  from 

1  to  n.  . 

1 

9  denotes  the  empty  set 

TT  always  denotes  the  price  vector  (  simplex  multipliers) 
associated  with  a  basis  B, 

y  always  denotes  the  cost  vector  associated  with  a  basis  B 
By  definition  we  have  ir  B  = 

w  always  denotes  a  vector  of  basic  variables  associated 

with  a  basis  B.  By  definition  Bw  =  b, 

J  =  {i/x  .  is  a  basic  variable}  denotes  the  set  of  basic  ac- 
•  J 

tivities;  therefore,  w  =  x  . 

Z  always  represents  the  value  of  the  objective  function. 
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Unless  otherwise  specified,  these  notations  will  be  consistently 

used,  and  often  without  further  explanation. 

It  remains  to  indicate  briefly  how  the  indices  will  be  used.  For 

an  iterative  process  we  will  adjoin  an  argument  t  to  any  quantity  which 

t  Yi 

might  vary.  Thus,  the  basis  B  of  a  linear  program  at  the  t  iter¬ 
ation  will  be  denoted  by  B(t),  the  simplex  multipliers  by  it  (t)  and  the 
values  of  the  basic  solutions  by  w(t).  The  next  feature  which  requires 
distinctive  notations  is  the  decomposition  of  a  linear  program  into 
smaller  subprograms.  In  this  case,  all  quantities  relative  to  the  i*^ 

subprogram  will  have  a  superscript  i,  e.  g.  B^(t),  ir^t),  w^(t)  which 

th 

are  not  to  be  confused  either  with  the  i  column  of  B(t),  i.  c.  ,  B.(t), 


1 

th  \ 

or  with  the  i  components  of  tt  (t)  and  w(t)  jtr.ft)  and  w,(t)|  . 

Finally,  a  word  about  our  numbering  system.  Theorems,  def¬ 
initions,  remarks  as  well  as  equations  are  all  numbered  consecutively 
within  each  chapter.  A  reference  to  an  equation  outside  a  given  chap¬ 
ter  will  be  made  by  prefixing  the  chapter  number  to  the  equation  num¬ 
ber.  The  numbers  in  square  brackets  refer  to  books  and  papers  listed 
in  the  bibliography  at  the  end  of  this  report. 


CHAPTER  II 


OPTIMIZATION  BY  PRICE  COMMUNICATION 
BETWEEN  LEONTIEF  SYSTEMS^ 


2  -  1  .  Introduction. 

In  this  chapter  we  shall  be  concerned  with  large  linear  pro¬ 
gramming  problems  based  on  interconnected  Leontief  systems  whose 
activity  levels  are  unbounded  and  whose  coefficient  matrices  have  a 
form  similar  to 


!  A  , 

I 

I 

-I 

1  ' 

_ -1  ■  ' 

'  2 

1  A 

-I 

I 

I  1 

-I  ^ 

' 

a'  I 

LI 

where  A  ,  A  and  A  are  Leontief  matrices  with  substitution  whose 
precise  definition  will  be  given  in  the  next  section 

We  shall  determine  some  important  properties  of  this  class  of 
problems  by  concentrating,  in  the  following  sections,  on  a  decomposi¬ 
tion  procedure  based  exclusively  on  price  communication  between  the 
Leontief  systems.  It  should  be  noted  that  this  decomposition  procedur 
has  only  a  limited  practical  interest  for  the  following  reasons; 

^Basically,  the  ideas  developed  in  this  chapter  were  suggested 
by  Prof.  G.  B.  Dantzig  during  a  seminar  on  Computational  Methods  in 
Mathematical  Programming  which  was  given  during  the  fall  semester 
1962  at  the  University  of  California,  Berkeley. 
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(i)  we  prove  only  that  an  optimal  basis  to  the  original  problem 
can  be  found  in  a  finite  number  of  iterations; 

(ii)  no  optimality  criterion  is  given; 

(iii)  a  better  convergence  to  the  optimal  basis  can  be  achieved 
by  another  method  described  in  chapter  3, 

Nevertheless,  as  will  be  illustrated  in  chapter  3  we  remark  that  for 
the  first  iterations  the  above  method  could  give  good  results  and,  there¬ 
fore,  might  be  efficiently  used  to  find  an  improved  initial  basis  to  a 
more  complex  decomposition  approach.  Also,  it  might  be  advantageous 
to  use  the  price  communication  decomposition  algorithm  in  certain 
cases  where  only  near-optimal  solutions  are  desired.  However,  the 
main  point  of  this  chapter  is  not  to  present  a  working  algorithm,  but 
to  demonstrate  that,  under  certain  ideal  conditions,  the  price  com¬ 
munication  technique  alone  can  lead  to  the  selection  of  an  optimal  basis. 

For  convenience  in  exposition,  we  summarize  in  the  next  sec  - 
lion  some  properties  of  the  Leontief  systems  which  will  be  used  through 
out  this  report.  In  section  3  we  describe  the  price  communication  de¬ 
composition  procedv.re  for  two  interconnected  Leontief  systems  and 
prove  some  properties  justifying  its  validity.  The  questions  of  con¬ 
vergence  and  finiteness  of  the  method  will  be  dealt  wuth  in  section  4 
Finally,  in  the  last  section  we  briefly  indicate  how  to  extend  the  pro¬ 


cedure  to  the  case  of  N  Leontief  systems. 


2  - 2 .  Review  of  Some  Properties  of  Leontief  Systoms. 
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We  shall  now,  for  future  reference,  briefly  review  some  of 
the  important  properties  of  Leontief  systems.  Most  of  the  general 
properties  of  Leontief  matrices  can  be  found  in  an  expository  paper 
by  Woodbury  [37],  but  we  shall  mostly  refer  to  Dantzig  and  Wets  [l7] 
and  Gale  [21]. 

(11  Definition.  An  (m  X  n)  matrix  (m  >  n)  is  called  a  Leontief  matrix 
with  substitution  if  and  only  if  each  column  contains  exactly  one  and 
each  row  at  least  one  element  which  is  positive. 

It  should  be  noted  that  a  coefficient  matrix  of  a  linear  program 
which  is  a  Leontief  matrix  with  substitution  as  defined  by  (1)  can  al¬ 
ways  be  transformed  by  scaling  the  variables  into  a  Leontief  matrix 
whose  positive  elements  are  all  equal  to  one,  i.  e.  ,  into  a  matrix  of 
the  form" 


(2) 


A  = 


1 . 

.  .  .  .  1 

■^1, k+r 

■^le 

■^In 

^21 

■^2k 

1 

-"2e 

■^2n 

^ml 

'^mk 

-  a 

m,  k  +  1 

...  1  . 

....  1 

a  1 1 
a .  >0 


Normally,  it  is  this  form  w'hich  will  be  used  in  this  report,  in 
the  same  way  we  define  a  simple  Leontief  matrix. 

(3)  Definition.  A  matrix  B  is  called  a  Leontief  matrix  if  it  is  a  square 
Leontief  matrix  with  substitution,  i.  e.  ,  if  each  row  has  one  and  only 
one  element  which  is  positive. 


/ 


I 
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If  a  Leontief  matrix  of  order  m  has  the  property  that  the  sum 
!  the  elements  of  every  column  is  strictly  positive,  then  the  follow¬ 
ing  theorem  holds. 

(4)  Theorem.  If  A  is  a  Leontief  matrix  of  order  m  and  satisfies  the 

condition  e  A  >  0,  then  the  inverse  of  A  exists  and  is  a  nonneeative 
m  ^ 

matrix,  where  e  =  (1,  1,  .  .  ,  1)  or,  more  generally,  e  -  (w,  , 

m  ml 

w.,  ,  .  .  ,  w  )  where  w.  >  0. 

2  m  1 

It  will  suffice  to  show  the  theorem  for  e  =  (1,  1,  .  .  ,  1) 

m 

since  the  rows  may  be  rescaled  so  that  w.  =  1  and  then  the  columns 

1 

rc'scaled  so  that  a..  =  1  for  all  i.  There  exist  several  ways  of  proving 
this  theorem.  Usually  the  proof  is  based  on  the  convergence  of  I 
A  +  A  ^  4-  .  .  .  where  A  is  a  nonnegative  matrix  defined  by  A  - 

I  -  A  and  A  ^  0  as  n  [21 ,  p  301  ]  .  A  different  proof,  based 

exclusively  on  the  properties  of  the  simplex  method,  hence  algebraic, 
is  given  in  [l  7]  .  |  j 

Considering  now  the  linear  program 

(5)  Minimize  Z  =  cx  subject  to  Ax  =  b  and  x  >  0  where  A  is  a  Leontief 
matrix  with  substitution,  we  state  the  following  well  known  results, 
detailed  proofs  of  which  can  be  found  in  [l  7] 

(6)  Lemma.  If  b  is  positive  (b  >  0),  then  any  feasible  basis  to  prob¬ 
lem  (5)  is  a  Leontief  matrix. 

Proof.  It  suffices  to  note  that  the  feasibility  requires  at  least 
one  positi/e  element  in  each  row  when  b  >  0.  || 


1  5 

Remark.  A  stronger  form  of  the  same  lemma  --  namely,  that 
any  basis  to  problem  (5)  to  which  corresponds  a  feasible  nondegenerate 
solution  is  a  Leontief  matrix  --  can  be  proved  in  a  similar  manner. 

(7)  Theorem.  If  e  A  >  0  then  there  exists  a  feasible  solution  to  prob- 
-  m 

lem  (5)  for  any  b  >  0. 

Proof.  If  e  A  >  0,  then  any  Leontief  submatrix  B  of  A  has, 

-  m 

according  to  (-I),  a  nonnegative  inverse.  This  implies  that  the  basic 
set  of  i-^tivities  defined  by  w  =  B  ^b  is  feasible  for  any  b  >  0.  || 

(8)  Theorem .  If  B  is  a  feasible  basis  to  problem  (5)  for  a  positive 
b,  then  it  is  a  feasible  basis  for  any  nonnegative  b. 

The  proof  of  this  theorem  rests  on  the  fact  that  if  B  is  a  feasible 
basis  corresponding  to  b  >  0,  then  B  ^  is  a  nonnegative  matrix;  there¬ 
fore,  the  same  argument  as  above  holds.  The  complete  proof  may  be 
found  in  [  1  7 ,  p.  2 1  ]  .  ]  | 

(^)  Theorem .  (Samuelson)  If  B  is  an  optimal  basis  to  problem  (5) 
for  a  positive  b,  then  B  is  an  optimal  basis  for  any  nonnegative  b. 

Proof.  The  simplex  multipliers  tt  associated  with  B  are  in¬ 
dependent  of  b  and  satisfy  the  dual  constraints 
(a)  TT  A  ^  c 

* 

because  B  is  an  optimal  basis.  But,  according  to  (8),  B  is  also  a 
feasible  basis  for  any  b  >  0;  hence,  the  vector  tt  is  the  same,  the 
relat  ion  (a)  still  holds  and  the  conclusion  of  the  theorem  follows.  || 

i 
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(10)  Remark.  At  this  point  it  should  be  emphasized  that  theorem 
(9)  is  not  equivalent  to  the  statement  that  the  optimal  selection  of  al¬ 
ternative  activities  is  independent  of  the  right  hand  side  b,  as  the  fol¬ 
lowing  counter-example  will  show. 

(11)  Counter-example.  Consider  problem  (5)  with  the  data 


A 


1  1  0 
0-.  5  1 


and  c  =  [  1 ,  2,  4] 


It  can  be  easily  checked  that 

(a)  if  b  =  [l,0]  then  B'  = 


h  1 

0-.  5 


is  an  optimal  basis 


(b)  if  b  =  [l,  I]  then  B'  is  not  a  feasible  basis  and  the 


optimal  basis  is  B‘ 


1  0 
0  1 


(c)  B  is  also  optimal  when  b  =  [l,  O] 

This  remark  is  not  really  restrictive  when  the  coefficient  matrix 

A  satisfies  the  condition  e  A  >  0,  because  we  know,  by  (7),  that 

m 

there  exists  a  feasible  solution  for  any  b  >  0.  Hence,  in  this  case 
when  an  optimal  soluiion  for  any  b  >  0  is  desired,  it  suffices  to  ap¬ 
ply  the  following  rule. 

(12)  Rule.  If  problem  (5)  satisfies  the  condition  e  A  >  0  ,  then  by 
solving  it  with  an  arbitrary  b  >  0  ,  an  optimal  basis  with  the  follow¬ 
ing  two  properties  if  found: 

(i)  it  is  a  Leontief  matrix  (theorem  6) 

(ii)  it  is  also  an  optimal  basis  for  any  b  >  0  (theorem  9). 


17 


2-  3.  Decomposition  Procedure  for  Two  Interconnected  Leontiei 
Systems. 

We  now  present  the  decomposition  procedure  by  price  communi¬ 
cation  to  solve  a  linear  program  of  the  form 
Minimize  Z  subject  to  the  constraints 


In  In  2  „  2  ^ 

x^o,  y>0i  x>o 


.  1  1 

1 

2 

A  X 

fly 

-  I  y  =  b 

m 

m 

,  1 

,  2,2  2 

-  I  y 

+  Iy  +  Ax  =  b 

m 

m 

1  1 

^2  2  2  2  2  2 

c  x 

+  d  y 

+  dy  +  cy  +  cy 

Z  (min) 


where  A  and  A  are  LeontiCf  matrices  with  substitution  of  size 

(m  X  n  )  and  (m  X  n  )  respectively,  and  I  is  an  identity  matrix 
X  M  ITX 

of  order  m. 

We  make  the  following  assumptions  which  will  be  used  in  later 
developments: 


(14)  e  a'  >  0  for  i  -  1,2 

m 

(15)  c^  >  0,  c^  >  0,  d^  >  0,  d^  >  0 

(16)  d^  +  d^  >  0 


We  shall  relate  the  solution  of  problem  (13)  to  the  solutions 


of  the  following  sequence  of  subproblems. 
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(17)  a(t) 


Minimize  Z  satisfying 

I  ^  i  ^ 

X  >  0  ,  y  >  0 

Ax  +  I  y  =  b 
m 

II  f.l  2,  ,,,  1  ,1  ,  .  , 

c  X  +  [d  +  TT  (t-  l)]y  =  Z  (mm) 


where  b  is  an  arbitrary  positive  vector  and  it  (t-1)  are  the  com¬ 
municated  o£tini^  simplex  multipliers  from  subproblem  b(t-l)  below. 


(18)  b(t) 


f 

I 

I 


Minimize 


2 

X 


>  0  . 


2  2 
c  X 


+  I 

m 


2 

y 

2 

y 


+ 


sati.sfying 

>  0 


(min) 


\ 

where  b^  is  an  arbitrary  positive  vector  and  ■rT^(t)  are  the  communi¬ 
cated  optimal  prices  from  subproblem  a(t). 

All  these  problems  are  well  defined  except  subproblem  a(  1 ) 

2 

for  which  tt  (0)  is  not  specified.  In  fact,  instead  of  a(l),  we  choose 
to  solve  the  problem 


Min  Z  =  c  X  subject  to  Ax  =  b  and  x  >0 

2 

This  can  be  achieved  by  setting  tt  (0)  =  and  solving  a(  1 )  as  stated 
above. 

We  turn  now  to  some  of  the  properties  of  subproblems  a(t) 
and  b(t).  Our  first  task  is  to  show  that  their  optimal  simplex  multipliers 
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TT  (t)  and  IT  (1)  converge  as  t  increases. 

(19)  Lemma.  Under  assumptions  (14)  and  (15),  ir^t)  >  0  and 

TT^t)  >  0  . 

Proof.  Note  that  (14)  guarantees  that  feasible  solutions  to 
a(t)  and  b(t)  exist  (see  7)  and  that,  by  assumption  (15),  >  0  for 

problem  a(  1 ).  Hence,  by  the  duality  theorem,  an  optimal  solution  to 
a(  1 )  exists.  Also,  according  to  (12),  we  know  that  an  optimal  basis 
to  a(l),  say  b\i),  is  a  Leontief  matrix  whose  inverse  is  a  nonnegative 
matrix.  Consequently,  since  the  basic  cost  vector  v^(l)  Is  nonnegative, 
the  simplex  multipliers  tt\i)  are  also  nonnegative,  i.  e.  , 


n'(l)  =  v‘(1)[b‘(1)J'‘  >  0 


and,  repeating  the  above  argument  for  b(2),  a(3) .  the  conclusion 

follows.  I  I 

1  2 

(20)  Lemma.  tt  (t)  and  tt  (t)  are  monotonically  nonincreasing  se¬ 
quences. 

Proof.  Because  the  set  of  activities  of  a(l)  is  a  subset  of  the 
activities  of  a(2)  it  is  obvious  that 


z\l)  >  Z^2) 


F  urthe  rmore, 

=  u. 


since  B  is  an  optimal  basis  for  any  b  >  0  ,  we  may 
a  unit  vector  with  1  in  i^^  component;  we  then  have 


choose  b 


20 


by  the  duality  theorem  Z^(l)  =  tt|(  1 )  and  Z^(2)  =  711(2)  and  this  for 
all  i  €  M  Hence, 

>  tt^(2). 

But  this  implies  that  the  cost  vector  of  b(  1 )  is  greater  than  or  equal 

2  2 

to  the  cost  vector  of  b(2);  hence,  Z  (1)  >  Z  (2)  and  by  the  same 
argunient  as  above 


TT^l)  >  7T^(2). 

Similarly,  assuming  that  -rr^t-  1)  >  ir^t)  we  show  that 

TT^(t  -  1  )  >  7T^(t) 

thus  completing  the  inductive  proof  of  this  lemma.  || 

1  2  1 

(21)  Theorem.  tt  (t)  and  tt  (t)  converge  respectively  to  tt,,  and 

2 

TT  ,  as  t-*  00. 

Proof.  By  «'19)  and  (20)  both  sequences  are  nonincreasing 
and  bounded  below  by  zero  So,  they  both  converge.  |  | 

We  now  (urn  to  some  definitions  which  will  be  used  throughout 
this  report, 

(22)  Definition.  We  call  respectively  importation  set  of  the  i^^ 
block  and  production  set  of  the  i^^  block  the  sets 
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by 


{j/j  ‘ 

M 

and 

J 

is  a  basic 

variable  } 

{j/j  « 

N. 

1 

and  x^ 

J 

is  a  basic 

variable  } 

Accordingly  we  denote  the  vector  of  basic  production  variables 


X  =  (x). 

J  J  J  t  J 


and  the  vector  of  basic  importation  variables  by 


V.  =  .  I 


Concerning  these  sets  it  will  be  useful  to  record  that 
(23)  Lemma.  Optimal  solutions  of  two  consecutive  subproblems 
a(t)  and  b(t)  have  the  property  that 


=  qp 


and 


Proof.  By  definition 


(t)  =  d^  +  Tr^(t-l) 

J  J  J 


2  2  1 

7T  (t)  =  d  +  TT  .  (t) 

J  J  J 


if  j  c  I 


if  j  c  I 


Adding  these  relations  we  have 
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TT^(t)  -  TT^d  -  1)  -  >  0  (by  16) 

J  J  J  J 

which  contradicts  (20).  This  completes  the  proof.  || 

Let  us  now  examine  how  the  solutions  of  subproblems  a(t)  and 

b(t)  are  related  to  the  solution  of  the  original  problem.  First  we 

show  that  the  matrix  B(t)  of  this  problem  whose  columns  correspond 

1  2 

to  optimal  bases  B  (t)  and  B  (t)  of  a(t)  and  b(t)  is  a  feasible  basis 
for  problem  (13).  It  will  be  convenient  to  partition  B(t)  as  follows: 


(24) 


B(t) 


B^t) 

E^(t) 

E^t) 

B^(t) 

1  2 

where  we  assume  that  the  optimal  bases  B  (t)  and  B  ( t)  have  their 

1  2 

positive  elements  on  the  diagonal  and  the  columns  of  E  (t)  and  E  (t) 
are  defined  by 


(25) 


E^(.,  .  -u^ 


if  J  €  r, 

=  0  otherwise 


K  =  1,  2 


Rema rk.  It  should  be  observed  that  the  assumption  that  the 
1  2 

positive  elements  of  Bit)  and  B  (t)  are  on  the  diagonals  does  not 
restrict  the  generality  of  this  exposition  since  the  simplex  algorithm 
applied  to  Leontief  systems  preserves  this  characteristic;  consequently, 
it  suffices  to  put  the  original  bases  in  the  proper  order. 

(26)  Lemma.  B(t)  is  a  feasible  basis  for  problem  (13). 

Proof.  Let  us  suppose  that  B(t)  is  a  nonsingular  matrix  and 
let  us  compute  its  inverse  (3(t>  by  the  partitioning  method  [26,  p.  35]. 
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Denoting  by  p  the  nonnegative  inverse  of  B  (t)  (which,  according 
to  (4)  and  (6)  exists)  we  have: 


P(t) 


5 


2 

2 


whe  re 


Under  the  assumption 
matrix 


[B^t)  -  E^(t)  p^E^t)]'^ 

-  p^ 

-  p^E^t)  p^ 

2  2  1  2 
P^  -  P^E^t)  5^ 

1  -  2 

I  I  =  q)  we  prove  in  chapter  3  that  the 


B  ^  (t)  -  E^(t)  p^E^  (t) 

is  a  Leontief  matrix  satisfying  e^B^  >  0.  Hence,  by  (4)  its  inverse 
B^  exists  and  is  a  nonnegative  matrix.  As  can  be  easily  verified, 
this  implies  that  the  remaining  matrix  equations  of  (26)  are  all  de¬ 
fined  and  are  nonnegative.  Hence,  p(t)  is  a  nonnegative  matrix  and 
therefore  B(t)  is  a  feasible  basis  for  any  nonnegative  right  hand  side 
b.  This  completes  the  proof.  j| 

Thus  far  we  have  only  seen  that  the  simplex  multipliers  Tr^(t) 

2 

and  TT  (t)  converge  and  that  our  decomposition  procedure  gives  us  a 
sequence  of  feasible  bases  B(t).  To  prove  the  validity  of  the  whole 
method  it  remains  to  be  shown  that  the  sequence  {B(t)}  will  converge 
in  a  finite  number  of  steps  to  an  optimal  basis  of  problem  (13).  This 
is  done  in  the  next  section. 


Let  us  turn  now  to  the  questions  of  convergence  and  finiteness 
of  our  decomposition  procedure.  We  shall  first  note  that,  if  for  any 
two  consecutive  iterations  the  simplex  multipliers  are  equal,  then  the 
iterative  process  is  ended.  More  precisely 

(28)  Lemma.  If  -rrSt-l)  =  or  TT^(t-l)  =  v^(t)  then  the 

basis  B(  t)  is  an  optimal  basis  for  problem  (13). 

Proof.  Pricing  out  the  activities  of  problem  (13)  with  the 
1  2 

simplex  multiplie r tt  ( t)  and  ti  (t)  we  have 

c^  -  TT^  ( t)A^  ^  0 

(29)  c^  -  -rT^(t)A^  >  0 

d^  +  TT^t)  -  Tr^(t)  >  0 

as  a  direct  consequence  of  the  definitions  of  •iT^(t)  and  iT^(t).  How¬ 
ever,  nothing  can  be  said  about  the  siffi  of  the  expression 

(  30)  d^  +  TT^(t)  -  7T^  (t) 

since  the  equivalent  columns  in  the  prr  blem  a(t)  price  out 

(31)  d^  +  7T^(t-l)  -  IT^lt)  >  0 

2  2 

Nevertheless,  when  tt  (t)  -  tt  (t-1)  then  (30)  is  identical  to  (31). 

11  2  2 
Hence,  noting  that  tt  (t-1)  =  tt  ( t)  implies  that  tt  (t-1)  =  tt  (t), 

the  conclusion  of  the  lemma  follows.  || 
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(  32)  Theorem.  The  limiting  simplex  multipliers  tt^  and  tt.,^  are 
optimal  simplex  multipliers  to  problem  (13). 

Proof.  It  suffices  to  note  that  in  the  proof  of  the  preceding 

lemma 

(i)  the  relations  (29)  must  hold  in  the  limit  also; 

(ii)  the  expression  (30)  is  asymptotically  greater  than  or 

2  2  II 

equal  to  zero  since  tt  (t-1)  -iT(t)-^0ast-*®.  || 

So  far  we  can  conclude  that,  since  ■iT^(t)  and  iT^(t)  converge 
1  2 

to  TT^  and  Tijjj,  the  decomposition  procedure  by  price  communication 
tends  to  give  an  optimal  feasible  basis  for  problem  (13).  In  fact  we 
shall  show  now  that  the  choice  of  this  optimal  basis  is  reached  in  a 
finite  number  of  iterations. 

(33)  Theorem.  An  optimal  basis  B(t)  to  problem  (13)  is  reached 
in  a  finite  number  of  iterations. 

Proof.  Let  [x^  (t),  y  (t),  y  (t),  3r‘’(t)]  be  the  basic  feasible 

solution  to  problem  (13)  which  is  associated  with  the  basis  B(  t) .  By 

multiplying  the  rows  of  the  coefficient  matrix  (13)  by  (t)  and 
2 

TT  ( tl  and  subtracting  them  from,  the  cost  form,  it  can  be  easily  ver¬ 
ified  that  the  objective  function  Z(t)  of  (13)  has  the  value 

Z(t)  =  iT^(t)b^  +  Tr^(t)b^  +  [w^^L)  -  Tr^(  t-1 )  ]  y^  ( t). 
According  to  (20),  ■rT^(t)  -T^(t-l)  i  0;  therefore 

Z(t)  <  iT^t)b^  +  ir^(t)b^. 

Furthermore,  also  by  (20),  we  know  that  there  exists  for  a  given 
a  >  0  an  integer  N  such  that 
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TTSt)b^  <  +  a/2 

for  all  t  >  N 

2  2  2  2 
ir  (t)b  <  TT^b  +  q/2 

Hence,  oy  theorem  (32)  we  have 

Z(t)  <  Z  min  +  a  for  all  t  >  N 

Now,  let  us  suppose  that  is  a  nonoptional  basis  of  problem  (13). 
The  corresponding  value  of  the  objective  function,  say  Z°,  can  be 
written  as 

Z°  -  Z  min  +  h  (h  >  0) 

Therefore,  if  a  <  h,  we  have 

Z(t)  <  Z°  for  all  t  >  N 

This  means  that,  if  t  is  sufficiently  large,  the  nonoptional  basis 
cannot  be  chosen  by  our  procedure.  This  holds  for  all  nonoptimal 
bases  and  therefore  the  conclusion  of  this  theorem  follows.  || 

2-5.  Extension  to  N  Interconnected  Leontief  Systems. 

The  preceding  analysis  can  be  readily  extended  to  the  case  of 
N  interconnected  Leontief  systems  because  it  can  be  easily  shown 
that  all  the  results  of  the  previous  analysis  hold  in  this  case  also.  To 
illustrate  the  procedure  applied  to  such  a  case  we  consider  the  follov  - 
ing  linear  program  stated  in  detached  coefficient  form: 


Minimize  Z  subject  to 
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(34) 


1 

X 

2 

X 

3 

X 

12 

y 

13 

y 

HI 

HI 

m 

iiai 

Constants 

A* 

T 

i. 

1 

-I 

-I 

-I 

b^  2  0 

-I 

1 

I 

b^  2  0 

a' 

-I 

-I 

I 

I 

b^  2  0 

c' 

d‘2 

d‘^ 

d^' 

m 

ill 

Z  (min) 

Where  all  identity  matrices  I  are  of  order  m. 


In  this  case,  the  s  ubp  roblems  to  be  solved  are 


(35.) 


Minimize  satisfying 


a(t) 


I 

I  X  0,  y  2  0,  y  i  0 

'  A  ^  '  X  T  12^,  13 

I  A  ;•  +  1  y  +  I  y 


m‘ 


=  b' 


V 


+  [d^^  +  TT^(t-l)]y^^  [d^^  +  TT^(t-l)]y^^  =  Z^(min) 


Minimize  Z  satisfying 


v}  >  0. 


21  >  n  23  .  n 
y  2  0,  y  2  0 


b(t) 


.22^,  21  ,  23  r2 

Ax+Iy  +Iy  =b 


c^x^  +  Id^^  +  TT^t)]y^^  +  Id^^  +  tr^(t-l)]y^^  =  (min) 


'^Minimize  z}  satisfying 


c(t) 


x"  2 

0. 

«/  A 

y 

2  0,  y" 

a3  3 

T  31 

T  32 

A  X 

+ 

1  y 

m' 

+  I  y 

3  3 

C  X 

+ 

[d^^  +  r^(t)]  y' 

b' 


(min) 


t 
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~  1  -  2  “  3  1 

where  b  ,  b*" ,  and  b  are  arbitrary  positive  vectors,  and  tr  (t), 

2  3 

TT  (t)  and  IT  (t)  are  optimal  simplex  multipliers  to  the  subproblems 
a(t),  b(t)  and  c(t)  respectively. 

It  should  be  noted  that  the  above  subproblems  can  be  further 
simplified  by  introducing  importation  cost  vectors  d  (t)  defined,  for 
instance  for  k  =  1,  by 

d^(t)  =  min  d^^  +  7T^(t-l),  d^^  +  ■tT^(t-l)')  for  all  j  e  M 

J  V,  J  J  j  J  / 

With  this  simplification  subproblem  a(t)  becomes 


(36) 


( t) 


Minimize  subject  to 
>  0,  y^  >  0 
A  X  +  ly  =  b 
c  X  +  d  y  =  Z  (min) 


Thus,  the  subproblems  have  the  same  form  as  those  described  in  the 
preceding  sections,  with  the  exception  that  a  kind  of  indicator  vector 
has  to  be  set  up  to  determine  the  origin  of  every  importation  vector. 
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CHAPTER  III 

DECOMPOSITION  OF  TWO  INTERCONNECTED  LEONTIEF 
SYSTEMS  BY  SQUARE  BLOCK  TRIANGULARIZATION 


3  - 1  .  Introduction. 

From  now  on  this  report  will  be  essentially  devoted  to  the  de¬ 
velopment  of  a  decomposition  procedure  which  will  be  called  decompos i - 
tion  by  square  block  triangular ization.  The  underlying  idea  of  this  method 
IS  to  transform  successively  the  linear  program  to  be  solved  into  a 
series  of  equivalent  linear  programs  which  have  the  property  that  their 
c  urrent  feasible  bases  are  square  block  triangular,  i  e.  ,  have  the 
form 


b‘ 

e'  '  e' 

0 

i  E^ 

0 

0  B^ 

where  B  ,  B  and  B  are  square  matrices.  Under  these  conditions, 
we  shall  see  that  improved  solutions  to  these  equivalent  problems  can 
be  easily  found  by  solving  smaller  subproblems  which  will  be  referred 
to  as  improvement  subprograms.  Thus,  we  shall  see  that,  starting 
with  a  feasible  basis,  we  can,  through  a  sequence  of  improvements, 
solve  the  original  problem  by  solving  a  series  of  smaller  linear  pro- 
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grams.  We  mention  immediately  that  in  practice  the  equivalent  prob¬ 
lems  are  never  set  up;  they  serve  only  for  convenience  of  exposition. 
As  far  as  the  improvement  subprograms  are  concerned,  their  coef¬ 
ficient  matrix  is  not  constant,  and,  therefore,  they  will  have  to  be  set 
up  at  each  iteration.  However,  it  turns  out  that  for  the  case  of  inter¬ 
connected  systems  they  are  easily  obtained  by  a  slight  modification  of 
the  exchange  matrices. 

In  this  chapter  we  shall  start  the  study  of  the  decomposition 
method  by  square  block  triangularization  by  developing  it  in  connection 
with  the  problem  studied  in  the  preceding  chapter.  There  are  two  main 
reasons  for  doing  this: 

(i)  we  finish  the  study  started  in  the  preceding  chapter; 

(ii)  the  method  has  remarkable  properties  in  this  case  which 
will  simplify  the  exposition  and  illustrate  once  more  the 
ideal  behavior  of  Leontief  systems.  This  illustration  is  im¬ 
portant  because  it  will  show  very  clearly  what  is  the  min¬ 
imum  exchange  of  information  which  will  be  required  to 
solve  efficiently  by  decomposition  a  linear  program  based 
on  interconnected  systems. 

Consequently,  we  shall  again  be  essentially  concerned  with 
linear  programming  problems  of  the  form 
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X4  ^  11  ^11  2  22 

Minimize  Z  =  cx  +  dy  +dy  +cx 

112  2 
subject  to  x^O,  y>0,  yiO,  x^O 


a1  1  T  1  T  2  ,1 

Ax+Iy-Iy  =b 

m  m 

T  1  T  2  22  ^2 

-ly  +  Iy  +  Ax  =  b 
m  m 


1  2 

where  A  and  A  are  Leontief  matrices  with  substitution,  and,  as 
before,  we  shall  make  the  following  assumptions. 


(2)  e  A  >  0 
m 


e  A  >  0 
m 


(3)  c*  2  0.  2  0,  d^  2  0,  d^  2  0 


(4)  d^  +  d^  >  0 


Remarks.  (i)  It  should  be  noted  that  assumption  (4)  is  a  necessary 
condiiior.  for  the  existence  of  an  optimal  solution  to  problem  (1),  where¬ 
as  the  assumptions  (2)  and  (3)  are  only  sufficient  conditions  made  here 

❖ 

for  the  convenience  of  exposition. 

(ii)  We  recall  (2-12)  that  problem  (1)  can  best  be  solved  by 

1  2 

taking  arbitrary  positive  right  hand  sides  b  and  b  because  the  op¬ 
timal  basis  obtained  with  these  values  is  optimal  for  any  b^  >  0  and 
2 

any  b  2  0.  Accordingly,  without  loss  of  generality,  we  shall  assume 

1  2 

throughout  this  chapter  that  b  >  0  and  b  >  0  (except  in  the  state- 

1  2 

ment  of  the  algorithm  where  we  replace  b  and  b  by  e^  for  pre¬ 
cisely  the  reason  indicated  above). 


In  fact,  it  can  be  shown  that  (3)  is  superfluous. 
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In  this  chapter  vve  first  give  some  additional  propert.es  of 
Leontief  matrices  in  relation  to  square  block  triangularity  in  section 
2.  In  section  3  we  list,  for  future  reference,  a  series  of  simple  re¬ 
sults  related  to  the  transformations  of  the  original  problem  into  equiv¬ 
alent  problems:  also  we  discuss  the  computational  aspects  of  such 
transformations.  In  section  4  the  validity  of  the  decomposition  method 
by  square  block  triangularization  to  solve  problem  (1)  will  be  proved, 
and  in  section  5  the  corresponding  algorithm  will  be  stated.  Finally, 
in  section  6  we  briefly  compare  this  method  with  that  of  the  preceding 
chapter  as  well  as  with  tne  decomposition  method  of  Dantzig  anO  Wolfe. 

3  -  2 .  Square  Block  Triangularity  and  Leontief  Matrices. 

In  this  section  we  prove  some  further  properties  of  Leontief 
matrices  which  will  be  needed  for  the  decomposition  procedure  described 
in  this  chapter.  However,  since  these  properties  have  an  interest  of 
their  own,  we  shall  treat  this  section  rather  independently,  referring 
only  to  the  theorems  of  section  (2-2),  duplicating  a  few  minor  results 
of  the  preceding  chapter. 

We  consider  a  square  Leontief  matrix  of  order  m  partitioned 
a  s 


where  A  and  A  are  square  Leontief  matrices  of  order  p  and  q 
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respectively  and,  consequently,  A  and  A  are  nonpositive  matrices. 

Let  us  turn  our  attention  first  to  the  steps  which  are  necessary 
to  transform  the  above  matrix  A  into  a  square  block  triangular  matrix 

X. 

(6)  Definition.  The  matrix  X  is  said  to  be  block  triangular  if  it  has 
the  form 


X  =  PA  = 


and  it  is  said  to  be  square  block  triangular  if  X  and  A  are  square 
matrices. 

Assuming  that  submatrix  A^  is  nonsingular  and  denoting  its 
inverse  by  a'  we  define  a  nonsingular  transformation  matrix  P  by 


(7) 


P 


I  0 

P 
2 

-A  a'  I 

q 


Premultiplying  A  by  P  we  obtain  the  square  block  triangular  matrix 


(8) 


X  = 


1  3  ^ 

A*  A^  I 


0 


where 


(9) 


r*  =  a"  -  a^o'a^ 
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We  shall  see  now  that  this  transformatior  preserves  the 

4 

Leontief  properties  of  matrix  A  .  More  precisely 


(10)  Theorem.  If  the  matrix  A  has  the  property  that  e  A  >  0,  then 

m 


A  is  a  Leontief  matrix  having  also  the  property  that  ^  ^  Q- 


Proof.  The  assumption  e  A  >  0  can  also  be  written  as 
-  m 


1 

2  ^ 

(i) 

e  A 

+  e  A  >  0 

P 

q 

(ii) 

3 

4 

e  A 

+  e  A  >  0 

P 

q 

Noting  that  ^  ^  know  by  theorem  (2-4)  that  the  inverse  a'  of 

A^  exists  and  is  a  nonnegative  matrix.  Hence,  the  transformation 

_4 

matrix  P  as  well  as  the  matrix  X  exist  and  A  is  well  defined.  By 
—  4 

definition  of  A  we  have 


e  A  =  e  a"^  -  e  A^q^  A^ 

q  q  q 


4  3 

But,  by  assumption  (ii),  e  A  >  -  e  A  ;  therefore, 

q  P 


(12) 


eA  >-(e  +eAQ)A 

q  P  P 


By  definition  A  is  a  nonpositive  matrix;  therefore,  in  order  to  prove 
that 

(iii)  e  A  >  0 

q 


holds,  it  suffices  to  verify  that 
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(13)  e  +  eAa  -(eA  +  eA)Q 

P  P  P  P 

is  nonnegative.  This  is  so  by  assumption  (i)  and  by  the  fact  that  is 

a  nonnegative  matrix.  Hence  (iii)  is  satisfied. 

_4 

It  remains  to  be  proved  that  A  is  a  Leontief  matrix.  We  note 
that  (iii)  implies  that  each  column  has  at  least  one  positive  element. 
Furthermore,  A^a^A^  is  a  nonnegative  matrix;  therefore,  the  positive 
elements  of 


-  A^a'A^ 


can  only  be  those  of  A  .  Hence  A  is  a  Leontief  matrix.  || 

We  shall  extend  the  preceding  result  to  the  case  of  a  square 
non- singular  Leontief  matrix  of  order  2m  having  the  form 


(14) 


B 


\ 

D‘ 

1. 

« 

•1 

-1 

*•-1 

0 

b‘  e'1 

i 

I 

1 

••1 

2 

2 

0 

-1. 

D 

E  B  J 

« 

-1 

where  D  and  D  are  Leontief  n>atrices,  of  size  (m  X  p)  and  (m  x  q) 
respectively,  satisfying  the  conditions 


e  >  0 

m 


e  >  0 

m 


< 


I 


(15) 


and 
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Also,  the  positive  elements  of  B  are  assumed  to  be  on  the  diagonal. 

However,  before  proving  our  next  theorem,  let  us  pause  to 
introduce  some  definitions  and  to  state  a  necessary  and  sufficient  con¬ 
dition  for  a  matrix  B  to  be  nonsingular. 


(16)  Definitions.  We  call  B  a  Leontief  matrix  with  interconnections, 
and  the  columns  B.  of  B  which  have  an  element  -1  interconnection 


columns. 


The  column  of  B  corresponding  to  an  interconnection  column 
B  of  B  is  called  an  importation  column,  whereas  the  column  of 


corresponding  to  the  same  B^  is  called  exportation  column. 

Finally,  we  call  importation  set  the  set  defined  by 


=  {  j|  j  e  M  and  B^  is  an  importation  column}  for  i  =  I,  Z 


Proof.  Consider  the  matrix  B  obtained  by  multiplying  the 
rows  of  B  having  an  element  -1  by  the  scalar  (1  -  e  )  >  0  ,  e  >0,  i.  e.  , 


0 

b' 

e' 

B  =  MB  ^ 

0 

X 

e‘ 

where  M  and  M  have  the  form 
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M 


l-€ 


1-e 


•  1 


To  prove  that  B  is  nonsingular  it  suffices  to  prove  that  there 
exists  an  I  >  e  >0  for  which  B  is  nonsingular.  To  show  this  we  ob¬ 
serve  that,  as  a  consequence  of  (15),  there  must  exist  an  e  >  0  which 
is  small  enough  to  preserve  property  (15)  for  B  also.  Furthermore, 
if  I  r>  I  =  <p  ,  then  the  columns  B^  of  B  corresponding  to  inter¬ 
connection  columns  have  also  the  property  e_  B.  >  0;  hence,  ac- 

2m  j 

cording  to  theorem  (2-4),  B  is  nonsingular.  Finally  to  prove  necessity 

1  2 

we  note  that  if  j  €  I  ,  and  if  j  €  I  ,  then  B.  =  -B,  and  B  is 

J  J+m 

singular, contradicting  assumption.  || 

1  2 

(18)  Corollary  1.  If  I  ,')  I  =  y  .  then  the  inverse  of  B  is  a  nonnega¬ 
tive  matrix. 

Proof.  From  the  preceding  proof  we  know  that 

b'^  -  b’^m 

where  B  ^  is  nonnegative  by  theorem  (2-4)  and  M  is  nonnegative  by 
definition.  || 

(19)  Corollary  2.  If  B  is  a  basis  of  a  linear  program,  then  B  is  a 
feasible  basis  for  any  nonnegative  right  hand  side  b. 

Proof.  Bw  =  b  =>  w=  B^b^Oby  corollary  1.  |  | 
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Turning  now  to  the  tr iangularization  of  B  we  premultiply  it  by  the 
nonsingular  transformation  matrix 


(20) 


P 


I  0 
m 


m 


and  we  obtain  the  square  block  triangular  form 


(21) 


B 


PB 


B  E 


0  B 


w'he  re 


(22) 


B  =  B  -  E  P  E 


2  . 


(23)  Theorem.  *5  is  a  Leontief  matrix  having  the  property  that 


e  B^  >  0 
m 


Proof.  Note  that,  since  e,  B  >  0  ,  the  proof  of  theorem  (10) 
-  2m 

holds  when  we  replace  the  signs  >  by  >  ;  however,  we  want  to  prove 

u  -^2 

that  e  B  >0. 
m 

.  2 

Considering  (12)  it  can  be  easily  verified  that  for  any  j  q  I 
strict  inequality  still  holds  and  therefore 


(e  B  ^)  >  0  for  all  j  ^ 

m  j  ^ 
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Hence,  it  remains  only  to  prove  that  the  inequality  holds  when  j  e  I  . 
To  do  so,  we  first  observe  that,  in  the  present  situation,  (13)  becomes 


(e  +  e  eS 

m  m 


where,  by  assumption, 


(e  +  e  eS.  >0  if  j 

m  m  j  ^ 


=  0  if  j  C  I 


1 


Furthermore,  the  inverse  of  B^  must  have  the  form 


H  0 
G  I 


vhere  H  is  a  nonsingular  matrix  with  only  nonnegative  elements. 


Therefore, 


...  ...1 


(e  B  +  e  E  )  p 
m  m 


>0  if  j  O 


12  2 

But,  by  assumption,  I  0  I  =  ;  therefore,  for  j  €  I 


(e  B^). 

J 


(e  B  +  e  E  )  P  E 
m  m 


.  >  0 


2  1 
since  Ej  is  a  unit  vector  with  unit  in  jth  component  and  j  4  I  for 


j  e  I  .  This  completes  the  proof. 
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(24)  Corollarv.  If  0^  =  then  0  <  (e  bS-  <  I  for  all  j  t 

_ _  _ z _ J _ 


Proof.  By  (17)  and  (18)  there  exists  a  matrix 


such  that  1^-03 

with  interconnections. 


B  = 


and  U 
Therefore, 


=  M  which  is  a  Leontief  matrix 
according  to  theorem  (23) 


—  2  2  1  2 
eB  =  eB+eeE>0. 
m  m  m 


If  j  c  I  ,  then  the  component  of  the  above  vector  can  be  written 
as 

I  -  e  0^  >  0  . 
m  J 

Noting  that  0j  ^  0  ,  the  conclusion  of  the  corollary  follows.  || 

Several  remarks  are  in  order  now.  First,  it  will  be  conven¬ 
ient  to  introduce  the  notations 

1  11  2  2  2 
0  =  -E  P  and  0  =  -E  P 

whereby  (21)  and  (22)  can  be  written  as 


I  0 

m 

B* 

B* 

E^ 

(25) 

B  -  PB  = 

0^  I 

L  rn. 

X 

e' 

0 
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and 

(26) 


112  1 
It  should  be  noted  that  0  and  0  E  are  submatrices  of  P  ;  hence, 

once  is  known,  it  is  very  easy  to  transform  B  as  defined  b'  (14) 

into  B.  We  illustrate  this  point  by  showing  below  the  structures  of 

the  various  matrices  involved. 


1  '  I 

D  0 


B 


XXX 

XXX 

0 

XXX 

A  *  X 

1  1 

h'c  =K  X 

0' 


0 

0 

*  ♦  X 

*  ♦  X 

1 

B' 


1 

r— 

1  , 

!  1 

1 

1 

1 

1 

1 

__1 

1  I  2 

where  indicates  an  element  p..  such  that  i  e  I  and  j  e  I  . 

U 

1  2 

An  economic  interpretation  of  the  elements  B.  .  modifying  B 
can  be  given  if  one  considers  the  matrix  B  as  a  feasible  cooperation 
plan  between  two  Leontief  economies  I  and  II  for  which  the  basic 
activity  levels  are  defined  by 


B  [w^ ,  w^]  = 


1 


42 


where  w^  for  j  f  and  w,^  for  k  ^  represent  importation  activi- 
J  h 

1  2 

ties  of  economy  I  and  economy  II  respectively.  Recalling  that  I  I  -  p 

d^l 

it  can  be  easily  seen  that  (  — r  ] .  -  6. .  ;  hence, 

^db‘^‘  ‘J 
^  1  2 

(27)  Interpretation.  If  i  e  I  and  j  c  I  then  represents  the 
additional  amount  of  commodity  i  that  economy  I  has  to  import  when 
economy  II  increases  its  importation  of  commodity  j  by  one  unit. 


Accordingly,  we  introduce  the  following 

(28)  Definition.  We  shall  call  the  matrix  0^  an  adjustment  matrix 

1  1  2 

and  the  elements  (3..  for  which  i  €  I  andj  e  I  adjustment  coefficients. 


3-3.  Equivalent  Problems. 

In  this  section  we  point  out  the  advantages  of  transforming 
problem  (1)  into  an  equivalent  linear  programming  problem  having  a 
square  block  triangular  basis,  and  derive,  for  future  reference,  a 
series  of  simple  equations  related  to  this  transformation.  Further,  we 
discuss  some  of  the  computational  aspects  of  the  square  block  tri- 
angularization  method. 

Assuming  that  we  know  a  feasible  basis  B  of  problem  (l),we 
coiiSider  its  t  vo  transforms  B  and  B,  defined  by  (21)  and  (29)  respec¬ 
tively.  We  recall  that  these  matrices  have  the  form 


1 

B 

b‘ 

i' 

0 

(29)  B  = 

B  = 

.0  B  ^ 

and  B  = 

,e' 

(29)  B 
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who  re 


=  -t- 

- 

b' 

- 

-eV 

Next, 

since  the  matrix 

which  transforms 

nonsingular  matrix,  we  can  transform  problem  (1)  into  an  equivalent 
}.  Dbl'  rn  by  premultiplying  the  coefficient  matrix  of  the  former  by 
P^.  T!iif  new  problem,  which  wil'i  be  referred  to  as  the  equivalent 
orcbletn  <  orresponding  to  the  basis  B,  can  be  stated  as 


-0) 


Minimize  Z 
subject  to 


1  I  .1  1  ,2  2  ^  2  2 

cx  +  dy  +  dy  +  cx 


aI  1 
A  X 

4' 

T  1  T  2 

I  y  -  I  y  = 

m  m' 

b* 

>1 

X 

- 

=2  1  =2  2  ^  .2  2 
Ty+Ty+Ax  = 

x‘  > 

0. 

12  2 
y*  >0.  y^  >  0,  x^ 

>  0 

where 


A* 


e*A‘ 


I  -  9^ 
m 

b^  +  fi^b^ 


We  note  that,  by  definition,  we  can  solve  either  the  original 
problem  or  the  equivalent  problem  since  both  have  the  same  solution 
set.  Of  course,  for  reasons  which  will  become  apparent  in  the  next 
section,  we  will  choose  to  solve  the  latter.  However,  before  we  go 
into  further  details,  it  will  be  useful  to  establish  the  following  rela¬ 
tions  between  these  two  problems. 
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Consider  first  the  problem  of  the  determination  of  the  values 

1  Z  - 1  z 

of  the  simplex  multipliers  [  tt  ti  ]  and  [  tt  tt  ]  associated  with  B 
and  B  respectively.  Denoting  the  cost  vector  corresponding  to  these 

r  1  2i 

bases  by  I  y  .  V  J  we  have,  by  definition 


(31) 


/  i  „  /  1  2, 

I  (tt  ,tt)B  =  (y  ,y)  and 

,-l  .2.^  ,  1  2. 

(tt  ,  tt  )  B  =  ( V  Y  ) 


Accordingly,  it  can  be  easily  verified  that 


(32a) 


.1  1.1 

J  TT  =  Y  (3 

^  .2  .2  -l|r2.,2 

TT  =  (y  -  TT  E  )p 


Hence,  recalling  that  by  definition  B  ^  =  B’^P,  we  have 


/  1  2.  ..1  -2.„ 

(tt  ,  TT  )  =  (tt  ,  TT  )P, 


1.  e.  , 


(33a) 


1  .1  ^  -Znl 

TT  -  TT  +  TT  d 


^  2  -2 
TT  -  TT 


-1  -2 

Similarly,  if  (n  ,  tt  )  are  the  simplex  multipliers  associated 


with  B  we  have 


(32b) 


-1  ,  1  -2„1.-1 
J  tt  =(y  -  ttE)P 

^  2  2 


and 


1  -1 
TT  =  TT 


2  -2  ^  -ln2 

TT  =  TT  +  TT  (7 


(33b) 
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Finally,  the  following  relations  will  also  be  useful 


,  -1 

-1  ^ 

(34a) 

=  TT  + 

'  -2 

.2 

TT 

=  IT  - 

or 

-1 

~1 

sV 

<  .2 

TT 

=  TT  - 

(34b) 

Two  remarks  must  be  made  now.  First,  note  that,  if  the  col¬ 
umn  eliminated  during  a  simplex  step  applied  to  problem  (30)  belongs 

2 

to  the  matrix  "E  ,  then  the  new  prices  it  can  be  obtained  by  computing 

2  _  j 

only  the  inverse  of  the  new  basis  "E  since  ir  remains  unchanged. 

This  remark  will  be  important  in  the  following  section. 

1  2 

Next, the  above  relations  hold  whether  or  not  D  and  D  are 

1  2 

Leontief  matrices;  the  only  conditioned  required  is  I  H  I  =  9  • 

§ 

The  next  problem  we  consider  is  the  representation,  say  A  , 

s 

of  a  vector  A  in  terms  of  the  basis  B.  By  definition  we  have 
s  ^ 


(35) 

where  A 


(36) 


A*^  =  B"^A  =  B’^A 
s  s 


pV 


i3  equal  to 


A 


I 

s 


-t- 


1 

s 


Consequently,  we  have 
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(37) 


(A^)*  .  p*[A^  -  E^IA^)*] 
(A^)"  =  F^[A^  +  S^a'] 


Obviously,  the  above  formula  can  be  applied  to  compute  the  feasible 

solution  corresponding  to  the  basis  B;  it  suffices  to  replace  A  by 

s 

b  =  (b^,b^)  to  obtain 


(38) 


=  P^[b^  -  E^w^] 

b^  +  e^b^] 


Finally,  we  have  to  indicate  the  equations  relating  the  inverses 
P  ,  P  ,  P  and  p  of  the  matrices  B  ,  B  ,6  and  "5  respectively.  How¬ 
ever,  before  doing  so  we  shall  introduce  a  very  convenient  formula 
due  to  Sherman  and  Morrison  [  3  5]  which  can  best  be  stated  [  3,  p.  36] 
as  follows : 

(39)  Lemma.  If  B  is  a  nonsingular  matrix  of  order  n  and  if 

B  =  B  +  CAD 

where  A  is  a  nonsingular  matrix  of  order  m  and  C  and  D  are  ma¬ 
trices  of  size  (n  X  m)  and  (m  X  n)  respectively,  then,  provided 
that  M  ^  exists, 

B’^  -  B’^  -  b'^cm’^db"^ 

whe  re 

M  =  Ia"^  +  db’^c] 

Proof.  It  is  easy  to  check  that  BB  ^  =  1.  This  completes 


the  proof.  | 
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A  particular  case  of  this  lemma  is  the  following  well  known 
result  I  9.  p.  198]  ; 

(40)  Corollary.  If  a  column  of  a  nonsingular  matrix  B  is  re¬ 
placed  by  a  column  ,  i.  e.  ,  if 

B  B  +  (  P  -  P  )u' 
s  r  r 


then,  provided  that  P^^  i-  0, 


( P  -  u  )  B"^ 
p's  r'  r 

rs 


_  <1  I 

where  P  =  B  and  B  is  the  r^^  row  of  B 

s  s  r 

Proof.  Applying  (  39)  we  have 


b’Sp  -  P  )  B’^ 
s _ r  r 

1  +  B’^(P  -  P  ) 

r  s  1 


which  is  equivalent  to  the  form  given  above,  since  by  definition  P  = 

s 

B'^P  and  B'^P  =  u  .  || 
s  r  r  ' ' 

Remark.  Note  that  P  ^  0  is  a  necessary  and  sufficient  con- 
-  rs  ' 

dition  for  B  to  be  nonsingular. 

1  2 

We  are  now  in  a  position  to  give  the  relations  between  ^  ,  p  , 

1  2 

J3  and  ^  .  To  do  this  we  extend  our  notations 


to 


6  =  -  E  p  and  6  =  -  E  p 


-  E 


and 


We  have  three  cases  to  consider. 


1  2 

(i)  When  p  and  p  are  known,  then 

-  E^p^E^  =  (I  -  6^9^) 

hence 

(41)  P^  =  p^[l  -  9^9^]'^ 

and,  similarly, 

P^  =  P^  [I  - 

1  —2 

(ii)  When  p  and  p  are  known,  then 


B^  =  B^  +  E^p^E^  =  (I  +  9^15^)B^i 
so 

(42)  P^  =  p^  [  I  +  9^^]'^ 

2  *1 

and,  similarly,  when  p  and  p  are  known 

p^  =  p^  [  I  + 


(iii)  When  p^  and  p^  are  known,  one  can  compute  directly  p 

—  2  2  112 

by  applying  (39);  the  *riverse  ofB  =  B  -  EpE  is 


-2  2  2  1  -1  2  2 
P  ^  P  +  p  E  M  E  p 


whe  re 


M  =  [  -  E^p^E^]  =  B^ 


hence 
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and,  similarly, 

=  pM  I  + 

3 - 4 .  Decomposition  Procedure  for  Two  Interconnected  Leontief  Systems. 

We  come  now  to  ihe  object  of  this  chapter  which  is  the  develop¬ 
ment  of  an  efficient  decomposition  procedure  to  solve  problem  (1). 

As  was  done  in  Chapter  II,  we  shall  set  up  tw'o  subproblems  which 

1  2 

will  be  based  on  the  matrices  A  and  A  respectively,  and,  as  be¬ 
fore,  these  subproblems  will  be  perfectly  symmetric  in  the  sense  that 
the  required  kind  of  information  exchanged  is  the  same  in  both  direc¬ 
tions.  The  difference  between  both  methods  lies  essentially  in  the  fact 
that  here  the  simplex  multipliers  of  the  subproblems  will  also  be  the 
simplex  multipliers  of  the  equivalent  problem.  To  achieve  this  we 
will  have  to  adjust  the  coefficient  matrices  of  the  subproblems  at  each 

iteration.  This  can  be  done  quite  easily,  as  we  shall  presently  see. 

1  2 

First,  recall  that  we  assumed  that  b  and  b  are  positive; 
therefore,  according  to  (2-6),  any  feasible  basis  to  problem  (1)  must 
be  a  Leontief  matrix.  Consequently,  if  the  simplex  method  is  applied 
to  solve  problem  (1),  then  the  pivot  row  will  be  determined  by  the 
position  of  the  positive  clement  in  the  column  to  be  in'roduced.  Thus, 

(44)  Remark.  In  any  feasible  basis  B  to  problem  (1)  the  sub¬ 
matrices  and  B^  correspond  to  coefficient  columns  associated 
11  2  2 

w'ith  (x  ,y  )  and  (x  ,y  )  respectively. 

Next,  we  assume  that  we  have  a  feasible  basis,  say  B,  to 
problem  (1),  and  we  consider  the  equivalent  problem  (30)  associated 
with  it.  In  order  to  improve  the  basic  solution  corresponding  to  B  we 
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apply  the  simplex  method  to  this  problem,  limiting  the  pivot  choice  to 
2  2 

the  variables  x  and  y  only.  It  is  a  simple  matter  now  to  show  that 

the  simplex  steps  thus  performed  can  be  carried  out  simply  by  solving 

the  following  subproblem  which  will  be  referr'id  to  as  the  improvement 

2 

subprogram  based  on  B  . 


(45) 


j  Minimize  Z  satisfying 

.2  2  ^  _2  2  ,2 

A  X  +  T  y  =  b 

^  c^x^  +  t^y^  =  (min) 

I  x^  >  0,  y^  >  0 


where 


(46) 


=  [I  -  0^]  , 

T1 


and  =  M  - 


2  2-1  - 1 

t  =  [d  +  TT  ]  I  where  tt  is  defined  by  (32a) 

?  A 


(47)  Lemma.  The  coefficient  matrix  of  (4  5)  is  a  Leontief  matrix 
with  substitution  having  the  property 

e  >  0  and  e  >  0 

m  m 

Proof.  It  suffices  to  note  that  e  A^  >  0  holds  by  definition 
-  m  ' 

and  that 


e  =  e  ( u.  -  9^ ) 

m  j  m  j  j 


e  9^  >  0  by  (2'.).  I  1 
m  j  /  ^  /  I  I 


(48)  Theorem.  To  solve  the  improvement  subprogram  (45)  is 

equivalent  to  solving  problem  (30)  when  the  pivot  choice  is  restricted 

2  2 

to  the  variables  x  and  y  . 
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Proof.  First,  we  note  that,  according  to  (47)  and  (2-6),  any 
feasible  basis  to  subproblem  (45)  is  a  Leontief  matrix;  therefore,  by 
(18),  the  corresponding  matrix 

B  = 

IS  a  feasible  basis  to  problem  (30).  Next,  we  observe  that,  by  (44), 
no  column  of  is  eliminated;  hence,  by  (32a),  the  simplex  multi¬ 
pliers  TT^  associated  with  the  first  m  rows  of  B  are  constant  and  the 

2 

simplex  multipliers  tt  associated  with  the  last  m  rows  of  B  are  the 

-2 

simplex  multipliers  of  (30)  corresponding  to  the  basis  B  .  Conse¬ 
quently,  the  columns  of  (4  5)  and  the  corresponding  columns  of  (30) 
price  out  identically.  This  implies  that  the  pivot  columns  and,  there¬ 
fore,  the  pivot  rows,  are  the  same,  and  since  there  is  a  one  to  one 
correspondence  between  the  bases  B  and  B^  the  conclusion  of  the 
theorem  follows.  || 

The  above  theorem  tells  us  that  by  solving  subproblem  (45)  we 
find  an  improv^ed  basis  to  the  original  problem  (1).  To  this  basis  cor¬ 
respond  the  simplex  multipliers  (33) 


1 

TT 


2  2 

with  which  the  coefficient  columns  of  the  variables  x  and  y  price 
out  nonnegative.  If  the  coefficient  columns  of  the  variables  x^  and  y^ 
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also  price  out  nonnegative,  then  the  basis  thus  obtained  is  optimal  for 
problem  (1).  If  these  columns  do  not  price  out  nonnegative,  ther\  to 
further  improve  the  feasible  solution,  we  reverse  the  decomposition 
step  just  described  by  transforming,  this  time,  the  coefficient  matrix 
of  problem  (  1 )  by 


P 


2 


m 


e' 


0 


I 

m 


2 

where  9  corresponds  to  the  optimal  basis  found  by  solving  (45). 
Thus  we  obtain  the  new  improvement  subprogram 


(49) 


(  Minimize  satisfying 

.1  1  _1  1  ,1 

A  X  +  T  y  =  b 


1  1 


1  1 


1 


c  X  +  t  y  =  Z  (min) 


whe  re 


x^  >  0. 


1 


>  0 


=  (I^  -  6^) 

m  y  t 


and  -  M  -  I^ 


1  1  _2  —2 
t  =  (d  +  -n  )  y  where  this  time  tt  is  defined  by 

(32b) 


It  is  obvious  now  that,  by  solving  iteratively  the  two  subprob¬ 
lems  (45)  and  (49)  we  will  be  lead  in  a  finite  number  of  steps  (a  con¬ 
sequence  of  (46))  to  the  optimal  solution  of  problem  (1).  It  remains 
to  indicate  that  the  optimal  solution  to  problem  (1)  is  given  by  (38). 
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Finally,  to  summarize,  we  illustrate  in  figure  3-1  below  the 
steps  of  the  decomposition  procedure  just  described.  The  following 
is  the  key  to  the  numbers  in  parentheses  appearing  in  the  figure. 

( 1)  coefficient  matrix  of  problem  (  1) 

(2)  feasible  basis  B(0)  to  problem  (1) 

(3)  basis  to  equivalent  problem 

(4)  improvement  subprogram  a(l)  for  which  a  feasible  basi:. 
is  "5^(0) 

(5)  optimal  basis  to  a(l) 

(6)  improved  feasible  basis  to  problem  (1) 

(7)  basis  to  equivalent  problem 

(8)  improvement  subprogram  b(l)  for  which  a  feasible  basis 
is  B^O) 

(9)  optimal  basis  to  problem  (1) 

(10)  improved  feasible  basis  to  problem  (1) 
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3-5.  Algorithm. 

The  algorithm  for  solving  problem  (1)  which  is  based  on  the 
decomposition  method  outlined  in  section  3  will  solve  iteratively  the 
subproblems 


and 


a(t) 


Minimize  subject  to 


-T.1  1 

A  X  +  T  y  -  e 


m 


11  *11  ^1  /  .  V 

c  X  +  t  y  =  Z  ( min ) 


L  x^  >  0,  >  0 


f  Minimize  Z  subject  to 


^2  2  ^  ^2  2 
A  X  +  T  y  =  e 


b(t)  J 


m 


2  2  2  2  2 
c  X  +  t  y  =  Z  (min) 

x^  ^  0,  y^  >  0 


where 


1  2 

A  and  A  are  the  Leontief  matrices  with  substitution  of 


problem  ( 1) ; 

c^  and  c^  are  the  cost  vectors  of  problem  (1); 


e  is  an  m-component  vector  whose  elements  are  all  one. 


m 


112  2 

T  ,  t  ,  T  ,  t  will  be  defined  in  steps  3  and  4  below. 


We  now  list  the  steps  of  the  algorithm. 


I 


Step  1,  Solve  the  subproblem 


a(l) 


{ 


w 

Minimize  Z  =  c  x 


t.  .11  1  « 

subject  to  Ax  =  e^,  x  >  0 
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This  yields  an  optimal  basis  B  (1),  its  inverse  p  (1)  and  optimal 
simplex  multipliers  (1).  Set  1^(1)  =  (p  and  6^1)  =  0  ( zero  matrix) . 

Set  tT^I)  =  Tr^(l).  Go  to  step  2. 


Step  2,  Solve  the  subproblem 

2  22  r  2  »1  1  2 

Minimize  Z  "cx  +  [d  +  iT(l)]y 
2  2  2 

b(l)  /  subject  toAx+Iy  =  e 

mm 

2  2 
X  >  0,  y  >  0 

\ 

—2  ,2 

This  yields  an  optimal  basis  B  (1),  its  inverse  p  (1),  optimal  simplex 

__2  z  2  2 

multipliers  -rr  (1)  and  an  importation  set  I  (1).  Let  fir  (1)  =  ¥  (1) 
and  0^(1)  =  -  E^(l)p^(l)  (14)*^ 

Set  t  =  2  and  go  to  step  3. 

Step  3.  Solution  of  the  improvement  subprogram  a(t).  (49) 

The  following  data  from  b(t-l)  are  needed: 


>i« 

This  and  the  subsequent  numbers  in  parentheses  refer  to 
equations  given  in  preceding  sections. 


I 
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=  d^iul)  and  =  F^d-l). 

(a)  Compute  the  initial  simplex  mviltipliers  of  a(t) 

=  T^t-1)  +  irV(t-l)  (34a) 

and  also,  if  ir  (t*l)  is  not  easily  available, 
ir  =Tr  -irfi  =  ff  (t-1)  (34a) 

(b)  Set  up  the  coefficient  matrix  of  a(t)  with 

1  r  «2,  -2  2 

T  =  [I  -  ^  ,  where  I  =  M  -  I 

m  jZ 

t'-  =  [d^  +  2  (50) 

T 

(c)  Compute  the  inverse 

?*  =  p'(t-l)[I  -  oVd-l)]’*  (41b) 

1  «1 

(d)  Using  i  check  if  the  initial  basis  fi  is  optimal.  If  it 

is,  set  k  =  1  and  go  to  step  5.  If  not,  go  to  substep  (e). 

(e)  Solve  the  improvement  subprogram  a(t)  starting  with 

the  initial  basis  bI  This  yields  an  optimal  basis  B^(t). 

1  -1  -1 
as  well  as  I  (t),  p  (t)  and  ir  (t). 

(  f)  Compute  the  inverse 

P^t)  =  pNt)(l  +  where  5^  =  -  E^t)p^t)  (42a) 

Compute 

¥‘(t)  =  yV(‘)  (32.) 

and  set 

e^(t)  =  -  E*(t)  p'(t) 


Go  to  step  4. 
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Step  4.  Solution  of  the  improvement  subprogram  b(t)  . 

The  following  data  from  a(t)  are  needed 

=  I^t),  0^  =  0^t),  and  =  n^t) 

(a)  Compute  the  initial  simplex  multipliers  of  b(t) 

=  9^(t-l)  +  w^0^(t-l)  (34b) 

and  alsOj  if  IT^t)  is  not  easily  available, 

-  TtV  =  i-^t)  {34b) 

(b)  Set  up  the  coefficient  matrix  of  b(t)  with 

=  [I  -  0^]  ,  where  =  M  - 

m  yl 

=  [d^  +  *■*)  ,  («) 

(c)  Compute  the  inverse 

=  p^(t-l)(I  -  eVd-l)]'*  (41a) 

_2  —2 

(d)  Using  IT  check  if  the  initial  basis  B  is  optimal.  If  it 

is,  set  k  =  2  and  go  to  step  5.  If  not,  go  to  substep  (e). 

(e)  Solve  the  improvement  subprogram  b(t)  starting  with  the 

initial  basis  This  yields  an  optimal  basis  ^(t),  as 

well  as  I^(t),  p^(t)  and  TF^(t). 

(  f)  Compute  the  inverse 

p^t)  =  P^(t)  [I  +  where  6^  ^ 

(42) 

Compute 


-2  2  2 
7T  (t)  =  Y  P  (t) 


(32b) 
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and  set 

9^(t)  =  -  E^(t)  p^(t) 

(g)  Set  t  =  t  +  1  and  return  to  step  3. 

Step  5.  Computation  of  an  optimal  solution.  (38) 

(a)  if  k  =  1,  then  an  optimal  solution  to  problem  (1)  is 

w  =  p[b+6>b] 
w  =  p  [  b  -  E  (t-1)  w  ] 

(b)  if  k  ?  2«  then  an  optimal  solution  to  problem  (1)  is 

w  =p[b+abj 
1  «lri.l  t^2.  2i 

w  =  p  [b  -  E  (t-l)w  ] 

This  completes  the  statement  of  the  algorithm. 

Some  remarks  are  in  order  now.  First,  it  should  be  mentioned 

that  it  is  possible  to  limit  the  exchange  of  information  between  the 

ol 

subproblems  a(t)  and  b(t)  to  some  subsets  of  d  and  d  ,  which 

2  1 

must  necessarily  include  the  columns  corresponding  to  I  and  1  re¬ 
spectively,  provided  that  some  obvious  precautions  concerning  the 
optimality  criterion  are  taken.  For  instance  one  might  communicate 

o2 

to  subproblem  a(t)  only  the  columns  j  of  o  for  which  the  simplex 
1  2 

multipliers  it  and  tt  of  the  original  problem  satisfy  the  relation 

[d^  +  ttY  ^ 

J  J 


j  €  M. 


60 


We  have  reasons  to  believe  that  for  such  a  selection  the  convergence 
of  the  preceding  algorithm  would  not  be  greatly  affected.  The  above 
remark  should  be  important  for  the  solution  of  problems  concerning 
the  cooperation  between  two  economies. 

Finally,  we  wish  to  indicate  that,  if  in  step  3  the  m.atrix 

—  2  -1 
6  (t-1)  is  readily  available,  then  it  will  be  easier  to  compute  p 

through  (43).  Of  course,  the  same  remark  holds  for  step  4. 

3-6.  Conclusions. 

Some  concluding  remarks  are  in  order  now.  They  will  all 
have  to  do  with  comparing  the  preceding  algorithm  with  the  method  of 
chapter  II  as  well  as  with  the  decomposition  principle  of  Dantzig  and 
Wolfe  [9,  ch.  23].  We  are  not  going  to  prove  our  assertions,  but  will 
limit  ourselves  to  sununarizing  some  of  the  observations  we  have  made. 

First,  the  structural  parallelism  of  the  algorithms  of  chapters 
2  and  3  is  illustrated  in  figure  3-2.  As  was  already  indicated,  they 
have  in  common  the  fact  that  both  are  symmetrical  decomposition 
procedures  based  on  price  communication  between  the  two  sub-prob¬ 
lems.  However,  in  the  preceding  algorithm  some  additional  exchange 

of  information  is  required,  i.  e. ,  the  exchange  of  the  adjustment  matrices 
1  2 

6  and  9  (28).  It  is  this  additional  information  which  permits  the 

"acceleration"  of  the  convergence.  Why?  Simply  because  the  simplex 
1  2 

multipliers  (-tt  ,‘rr  )  corresponding  to  a  basis  of  problem  (1)  are 
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found  directly  by  the  square  block  triangularization  method,  whereas 

they  are  found  only  in  the  limit  by  the  price  communication  method. 

The  following  economic  interpretation  can  be  given  to  illustrate 

the  preceding  remark.  Suppose  an  economy  I  imports  from  economy 

2 

II  one  commodity  i  at  the  price  (t-1)  ,  and  suppose  that,  under 

these  conditions,  optimal  prices  for  economy  I  are  ir^t).  Next, 

suppose  that  economy  U  discovers  that  by  importing  commodity  j 

2  2 

from  economy  I  it  can  decrease  its  optimal  prices  it  (t-1)  to  it  (t). 

But  this  decrease  will  cause  a  decrease  in  ir^t+l)  which  in  its  turn 

2 

will  cause  a  new  decrease  in  it  (t+1),  and  so  on.  Now,  the  algorithm 

of  chapter  II  actually  follows  this  iterative  process,  whereas  the  al- 

1  2 

gorithm  of  chapter  III  finds  the  limiting  prices  it  and  it  right  away. 
For  further  clarification  of  this  remark  see  (27)  and  (28). 

The  comparison  with  the  decomposition  method  of  Dantzig  and 
Wolfe  would  require  a  lengthy  exposition.  We  shall  limit  ourselves 
to  the  following  conclusions. 

(i)  If  the  standard  decomposition  method  is  applied  to  the 
primal  problem  (1),  then  an  asymmetry  is  introduced  in  the  sense 
that  one  part  of  the  program  will  become  the  master  program  and  the 
other  part  the  subprogram.  Consequently,  the  exchange  of  information 
between  both  parts  is  not  the  same  in  both  directions. 

(ii)  It  can  be  proved  that  when  the  decomposition  principle  is 
applied  to  problem  (1),  it  is  advantageous  to  solve  the  subprogram 
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by  adopting  the  following  rules. 

(a)  solve  completely  the  subprogram,  disregarding 
any  homogeneous  solutions  which  might  arise. 

(b)  When  the  optimal  solution  is  found  in  (a),  consider 
all  the  homogeneous  solutions  and  introduce  them  in 
the  master  program. 

Note.  The  application  of  rule  (b)  corresponds  exactly  to  the  commun 

1  2 

ication  of  the  information  -BE  of  chapter  III. 

(iii)  It  can  be  shown  that  when  rules  (a)  and  (b)  are  applied, 
the  master  program  works  on  the  same  principle  as  the  algorithm  of 
chapter  111,  whereas  the  subprogram  has  the  same  function  as  a  sub¬ 
problem  of  chapter  II. 


This  contradicts  the  generality  of  the  empirical  statement 
[  7,  p.  11]  that  it  is  more  efficient  not  to  solve  the  subprogram  com 
pleteJy. 
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CHAPTER  IV 

GENERALIZATION  OF  THE  DECOMPOSITION  METHOD 
BY  SQUARE  BLOCK  TRIANGULARIZATION 

4 - 1 .  Application  to  N  Interconnected  Leontief  Systems. 

In  this  section  we  shall  see  how  the  decomposition  method  by 
square  block  triangularization  can  be  extended  to  solve  linear  pro¬ 
gramming  problems  based  on  more  than  two  interconnected  Leontief 
systems.  Generally,  these  problems  can  be  stated  in  detached  coef¬ 
ficient  form  as  follows: 

(1)  M  .limize  Z  subject  to  y^"^  i  0 


>  0 

x^  >  0 

>  0 

12 

V 

13 

Y 

21 

Y 

23 

Y 

31 

Y 

32 

Y 

const. 

A* 

I 

1 

-I 

-I 

b^  >  0 

-I 

I 

I 

-I 

b^  >  0 

a’ 

-I 

-1 

I 

I 

b^  >  0 

1 

c 

2 

c 

3 

c 

d^‘ 

d^^ 

Z  (min) 

where  we  assume  that 


(2) 


e  A  >  0  for  i  =  1,  2,  3 
m 


d  ■^  +  d"^  >0  for  i  i  j  and  i  =  1,  2,  3,  j  =  1,  2,  3 


c  ^0  for  i  =  1,  2,  3 


V 
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We  shall  first  consider  a  special  case  of  problem  (1)  (arising 
from  serially  interconnected  Leontief  systems)  whose  coefficient  ma¬ 
trix  and  feasible  bases  have  the  following  staircase  structures: 


A* 

0 

1 

-I  1  I 

a' 

I 

-I 

B  = 

e'' 

-I 

I 

A^  : 

0 

b' 

where  B  ,  B  and  B  are  square  Leontief  matrices. 

To  decompose  such  a  problem  the  following  generalization  of 
the  method  described  in  section  3-4  can  be  applied. 

(a)  Given  a  non-optimal  basis  B  we  consider  the  transforms 
tion  matrix 


P(a) 


I 

0 

0 

e(a) 

1 

0 

0 

0 

I 

where  6(a)  = 


Trl2„l 

-  E  p 


and  compute  the  simplex  multipliers 

TT  =  Y  P  • 

( b)  Premultiplying  by  P(a)  the  coefficient  matrix  A  we  ob¬ 
tain  an  equivalent  problem  whose  coefficient  matrix  has  the  form 
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(4) 


A(a)  = 


where 

A^=  0(a)A^ 

T ^  =  I  -  0(a) . 

We  note  that  the  corresponding  feasible  basis  is 


(5) 


B(a) 


P(a)B 


B^ 

0 

0 

B^a) 

0 

e“ 

b' 

where 


2  2  ^  21 
B  (a)  =  B  +  0(a)E 


(c)  Next,  consider  the  following  subproblem: 
Minimize  subject  to; 

(6)  , 


x^‘*0 

>  0 

23 

y  >0 

32 

y  >  0 

x^  >  0 

Constants 

I 

-I 

0 

e 

m 

-I 

I 

a’ 

e 

m 

2 

c 

,32 

d 

3 

c 

( min) 
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where 


r  ^  7^2  ,,  ,12 

I  y  J  ,  ^  and  I  =  M  -  I 

[I  -  0(a)]  ,, 


+ 


We  note  that  this  subproblem  is  the  problem  studied  in  chapter  III,  be- 

21 

cause,  according  to  III- (24),  the  matrix  T  has  the  property 


e  T 
m 


21 


>  0; 


hence,  subproblem  (6)  can  be  solved,  starting  with  the  basis 


B  = 
a 

by  the  algorithm  of  section  3-5. 

(d)  It  can  be  easily  verified  that  to  an  optimal  basis  of  sub¬ 
problem  (6)  corresponds  a  feasible  basis  of  the  original  problem.  If 
this  basis  is  not  optimal,  then  we  repeat  the  preceding  step  by  trans¬ 
forming,  this  time,  B  into 


B^(a) 

b’ 

-u.} 

J 


1 2 

By  definition  II- (22),  I  is  the  importation  set  {j/E 


which  corresponds  to  the  basic  variables  y. 


12 


J 


12 

k 
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B(b) 


P(b)B 


b‘ 

E^‘ 

0 

e‘' 

B^(b) 

0 

0 

E» 

where  B^(b)  =  B^  +  e(b)E^^  and  0(b)  =  - 

Thus,  the  decomposition  method  for  solving  a  multistage  Leontief 
system  is  a  straightforward  extension  of  the  method  outlined  in  chapter 
III. 

We  shall  briefly  show  now  that  the  same  holds  for  the  decom¬ 
position  method  for  solving  problem  (1)  in  general:  however,  more 
adjustments  have  to  be  made,  and  this  increases  the  necessary  ex¬ 
change  of  information  between  the  subprograms.  At  this  point  it  should 
be  recalled  that  the  decomposition  procedure  by  price  communication 
which  was  developed  in  chapter  II  yields  very  easily  a  feasible  basis 
for  problem  (1).  Therefore,  in  order  to  avoid  unprofitable  computa¬ 
tions,  it  is  suggested  that  this  method  be  used  to  determine  an  im¬ 
proved  starting  basis  for  the  decomposition  method  by  square  block 
triangularization  whose  basic  steps  are: 

(a)  transform  the  starting  feasible  basis  as  follows; 

(7)  B{a)  =  P(a)B  = 


I 

12 

I 

I 

B* 

E^‘ 

e’* 

e‘^ 

B^ 

e’^ 

e“ 

e“ 

b’ 

b‘ 

E^‘ 

e’‘ 

0 

■ail 

■an 

■sn 

X 
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whe  re 


9*^  =  -e‘2 


B^(a)  - 


E“,a»  .  e“  *  e*V‘ 


9'^  -  -e'^ 


B^a)  =  B^  .  e‘'E^' 


E^^a)  =  E^^  .  e‘V‘ 


(b)  note  that  the  improvement  program  has  the  form 


a‘ 

I 

1 

I 

-I 

1 

-I 

A* 

.T-‘ 

6^^ 

T^‘ 

I 

-I 

V 

-I 

t’‘ 

I 

^  —21  ,  .12  —31  ,  .13 

where  T  =1-6  and  T  =1-6 

(c)  Improve  the  basic  solution  of  the  original  proalem  (1)  by 

solving  the  following  improvement  subprogram  [see  III-(48)]. 

(8)  Minimize  Z  subject  to 


mi 

IBHI 

mi 

RRI 

RHI 

T^' 

a' 

I 

-I 

0 

0 

-I 

I 

a’ 

t’' 

e 

m 

2 

c 

d“ 

3 

c 

Z  ( min) 

where 


I 
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21 

X 


31 

X 


T 


21 


(I  -  9 


21 


(I 


t 


21 


+  T*) 


+ 


(9 


12 


(6 


(d)  Finally,  note  that  the  coefficient  matrix  of  (8)  is  a  Leontiei 
matrix.  Therefore,  a  decomposition  procedure  similar  to  the  algorithm 
of  section  3-5  can  be  applied  to  solve  this  subproblem.  It  can  be  ver¬ 
ified  without  difficulty  that  the  final  subproblem  to  be  solved  will  have 
the  form: 


(9) 


r  Min  Z  subject  to 


_32  23  ^  .3  3  31  31 

Tx  +Ax+Tx 


e 

m 


32  23  3  3  -31  31 

ttx  -♦-CX+t  X 


( min) 


where 


=  [I  - 


„32  ^23  ,2,  , 

9  =  -  E  |3  ( a) 


32  r^32  _2i 

(10)  t  =  [  d  +  TT  ] 


,31  ,  31  ^  3l2_2, 

T  =  [  t  +9  TT  J 


_2  2 
Y  P  (a) 


71 


4-2.  General  Two-Stage  Problem. 

In  this  section  we  shall  extend  the  decomposition  method  by  square 
block  triangularization  to  the  general  two- stage  problem 


Minimize  Z  subject  to 


(11) 


a1  1 

,  1  ,  2 

A  X 

+ 

1  y  -  I  y 

r 

m  m 

1 

T  1  r  2 

.2  2 

1 

- 

I  y  r  I  y 

+  A  X  - 

1 

m  m 

^  1  1 

^11  ^22 

2  2 

,  C  X 

1 

d  y  +  d  y  + 

C  X  = 

1 

i  1 

1 

2 

X 

> 

o 

] 

IV 

o 

1 

IV 

o 

=  >  0 

b^  >  0 

Z  (min) 
2  .  . 


1  2 

where  A  and  A  are  arbitrary  matrices  of  size  (m  X  n^)  and  ( m  X  n^) 
respectively,  and  d^  and  satisfy  the  condition 


(  12) 


d^  +  d^  >  0 


which,  as  indicated  before,  is  necessary  for  a  solution  to  problem 
(11)  to  exist. 

Basically,  the  method  to  be  described  will  be  similar  to  the 
one  outlined  in  section  3-4.  However,  in  the  present  case,  a  com  pli¬ 
cation  arises  at  each  simplex  step  of  the  improvement  subprograms 
because  we  have  to  take  into  account  the  possibility  that  the  new  cor¬ 
responding  basis  to  problem  (11)  might  become  infeasible.  The  main 
object  of  this  section  is  to  show  how  this  difficulty  can  be  overcome 
by  an  additional  exchange  of  information  requiring  only  simple  compu¬ 


tations. 


11 


We  begin  by  generalizing  our  notations.  To  do  this  we  must 
consider  a  feasible  basis  of  problem  (11)  which,  generally,  has  the 
form 


B 


1 

1 

1 

1 

0 

0 

1 

1 

+  1 

+  i 

where  the  submatrices  B  and  B  are  not  necessarily  square.  We 
shall  first  show  that 

(14)  Lemma.  ft  is  always  possible  to  transform  B,  by  column 
permutations  only,  into  the  matrix 


B 


— 

d' 

1 

-1 

1 

-1 

0 

1  0 

1 

1 

-1 

1 

-1 

1 
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where  B  is  a  nonsingular  submatrix  of  order  m. 

r  - 1  -  2, 

Proof.  Let  the  submatrix  L  B  ,  F  J  of  B  be  denoted  by 
[  D,  H,  O]  ,  where  H  corresponds  to  the  connection  columns,  and 
let  us  suppose  that  a  basis  for  this  submatrix  is 

-  [D,  H] 

where  D  and  H  are  submatrices  of  D  and  H  respectively.  We  first 
note  that  the  nonsingularity  of  B  implies  that: 

( i)  B  ^  has  rank  m 

(ii)  the  columns  of  D  are  linearly  independent 

(iii)  the  columns  of  H  are  linearly  independent. 

Next,  expressing  a  nonbasic  column  in  terms  of  B  V  i.  e.  , 

D.  ^  D\^  +  H\^ 

J 

we  note  that,  since  ( ii)  holds,  there  must  exist  at  least  one  component 
2  2 

of  \  ,  say  \j^,  which  is  nonzero.  Hence,  we  can  replace  in  the  basis 

B^  the  column  H,  by  the  column  D.  and  thus  obtain  a  new  basis.  By 

k  j 

repeating  this  operation  we  can  introduce  all  the  columns  of  D  into 
the  basis.  1 1 

Thus,  B  of  lemma  (14)  becomes  the  counterpart  of  the 
Leontief  matrix  III- (14);  accordingly,  we  generalize  the  definitions 
of  the  importation  sets  ll-(22)  as  follows: 
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(15) 


=  {i/E^  =  ±u.}  and 

J  » 


=  {i/E^  =  ±u.} 
J  1 


and  we  note  that,  since  B  is  nonsingular,  we  must  have 

(16)  n  =  qp 


We  turn  now  to  the  steps  of  the  decomposition  method  to  solve 
problem  (11).  To  do  this  we  shall  follow  the  development  given  in 
section  3-4  and  refer  to  it  whenever  the  situations  are  parallel. 

We  start  by  assuming  that  we  have  a  feasible  basis  to  problem 
(11)  which  has  the  form  (14).  Under  this  condition,  the  inverse  of  B 
exists  and  therefore,  as  before,  we  can  transform  problem  (11)  into 


1 


(17) 


subject  to 


can  be 

stated  as 

1  1 

^11  ^22 

=  C  X 

-f  d  y  +  d  y  + 

.1  1 

T  1  T  2 

A  X 

+  I  y  -  I  y 

m  m" 

tI  1 

^2  1  -2  2 

A  X 

-  T  y  +  T  y 

=  b' 


112  2 
x>0,  y>0,  y>0,  x>0 


where 


A* 
T  ^ 


=  [I  -  e*] 
m 

=  b^  +  0^b^ 


(18) 


f 
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and 


e*  =  -E’pi 


We  recall  that  a  feasible  basis  to  this  problem  is 


(19) 


B  = 


B  E 


0  B^ 


—  2  2  ..1  2 
where  B  =  B  +  0  E 


_ 2  —  1  _ 

and  we  note  that  B  must  be  nonsingular  since  |b|  =  |B  |  X  |B**|  ^  0 

Two  remarks  are  in  order  here. 


(i)  It  can  be  easily  checked  that 


T.^  =  0 
J 


when  j  c  I 


I 


-  2  2  -2  ^2 
(ii)  b  IS  not  necessarily  nonnegative,  although  w  =  p  b  5  0 

Next,  we  consider  the  following  subproblem  which  is  the  im¬ 


provement  subprogram  IlJ-(45): 


(20) 


2  2  2  2  2 
Minimize  Z  =  c  x  +  t  y 


subject  to 


2  2  2  2  -2 
Ax  +  T  y  =  b 

x^  >  0,  y^  >  0 


where,  if  J  ^  =  M  -  and  • 


m  Y 1 


=  (d-^ . 


T‘ 


t 


lb 


As  before,  it  can  be  easily  checked  that  as  far  as  the  determination  ol 

the  pivot  column  is  concerned,  the  above  subprogram  is  equivalent  to 

problem  (17)  when  the  pivot  choice  is  limited  to  the  variables  and 
2 

y  .  But  this  is  no  longer  true  for  the  determination  of  the  pivot  row, 
since  subprogram  (20)  disregards  the  first  m  components  of  the 
vector 

- 1  _  .1 

A  =  B  A  =  B  A 
s  s  s 


where  A  is  the  column  to  be  introduced  into  the  basis  B  of  (17).  We 
s 

recall  that,  when  solving  (  17)  by  the  simplex  algorithm,  the  pivot  row 
is  determined  by  the  criterion 


b 

r 


a 

r  s 


min  ('I 


1 


1 


where,  if  b  =  (b^,b^)  =  B  ^b  and 


A^  =  [A^A^]  =  b'^A  -  b“^A  , 
s  s  s  s  s 


(  21) 


1 

a 


min 


a^  >  0 

IS 


(a^  E  A^  ) 

IS  IS 


2 

a 


min 


a, 

IS 


} 
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Furthermore,  we  recall  that  we  have,  by  III-(37), 


(22) 


and 

(23) 


-1  Ar  A  ^2~2, 

A  =  P  A  -  E  A 
s  '  s  s 


S  *^  8  S 


2 

s 


b  =  P  [b  -  E  b  ] 


c2  :T2r^2  .FI, 

b  =  p[b  +  0b] 


At  this  point  it  is  easy  to  see  that,  as  expected,  a  is  deter¬ 
mined  by  the  subprogram  (20),  whereas  has  to  be  computed  separ¬ 
ately.  However,  it  should  be  noted  that  this  can  be  done  very  easily, 
since  all  the  data  necessary  for  the  computations  are  known.  Further¬ 
more,  it  should  be  emphasized  that  the  exchange  of  information  between 
the  two  systems  is  limited  to 


I 


E^A^ 

s 


2-2 
E  b 


and 


This  fact  could  become  important  in  case  of  decentralized  computations. 

1  2 

Finally,  it  remains  to  examine  what  has  to  be  done  when  a  <  a 
In  such  a  case  a  column  corresponding  to  the  matrix  has  to  be  elim¬ 
inated  from  the  basis  B,  and,  therefore,  a  new  problem  (17)  has  to 
be  set  up  which  will  require  the  following  operations: 


78 


(a)  determination  of  a  new  basis  ; 

(b)  computation  of  its  inverse  ; 

,  V  .  ,  _1  1„1 

(c)  computation  of  it  =  y  p  ; 

(d)  modification  of  the  coefficient  matrix  of  subproblem  (  20) ; 

-2 

(e)  computation  of  the  new  inverse  p  . 

This  seems  quite  formidable,  but  actually  is  not,  as  we  shall  sec  now. 

th  1 

If  we  assume  that  the  r*""  column  is  eliminated  from  B  ,  then, 

to  determine  a  new  nonsingular  B^  and  to  compute  its  inverse  p^  we 

apply  corollary  III- (40)  as  follows: 

(i)  If  (P^aS  ^  0,  then  we  replace  column  B^  by  and 

compute  the  new  p^  by  (24)  given  below,  with  P  =  P^A^  . 

s  s 

(Note  that  this  vector  was  computed  in  (22)). 

(ii)  If  (p^A^  =  0,  then,  according  to  lemma  (14),  we  can 

S  1* 

1  2  1 

replace  the  column  B  by  a  column  E,  for  which  P  ,  ^  0: 

r  k  '^rk 

—  1  2  1  -1 
we  let  P  -  (P  E  )  =  ±p  and  compute  p  by 

S  K  ic 


(24) 


p^  .  p^ 


- -  (P. 


s  r 


u  )  P 
r  r 


1  th  1 

where  B  is  the  r*^  row  of  3 
r  ^ 


The  column  permutations  of  these  operations  are  summarized  in  figure 
4.  1  below. 

Now  it  is  easy  to  carry  out  (c)  and  (d).  We  denote  the  new 

-1  u  -  1  j  u  u  si  r  u 

V  by  IT  and  the  new  u  by  o  .  It  remains  to  compute  the  new  p 


1 

2 

B 

E 

1 

2 

E 

B 

b‘ 

e‘ 
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which  will  be  denoted  by  p  .  Again,  v'e  have  to  distinguish  tv/o  cases 
corresponding  to  (i)  and  (ii)  above. 

2 

(i)  If  no  column  is  replaced  in  B  ,  then  by  a  formula  similar 
to  III  -  ( 4 1 )  we  have 


(25) 


f  =  (3^[I  -  (fl'  - 


where 


2  2 

(ii)  If  the  column  of  B  is  replaced  by  A  ,  then 

s 


^2  —2  rSl  olir^2  r-2  -Z.  1 

B  =  B  +  [  0  -  0  J  E  +  [  Ag  -  B^  ]  Uj^ 


—  2  -2  2 

where  A  =  p  A  .  In  this  case  again  we  can  first  apply 
s  s 

—  2  r  ::;1  1  2 

(25)  to  obtain  the  inverse  of  B  +  -  0  ]  E  and  then 

—  —2  -2 

(24)  (with  P  -  A  )  to  compute  p  . 
s  s 

At  this  point  it  must  be  emphasized  that  the  above  computations 
are  straightforward  since  almost  all  the  required  data  have  been  made 
available  by  preceding  computations.  However,  it  must  be  noted  that 
the  amount  of  computations  required  by  the  inversion  of  [  1  -  (0^  -  0^] 
in  formula  (25),  increases  with  the  size  of  the  set  i\  and,  therefore, 
the  above  procedure  is  adiantageous  only  when  is  small. 

From  now  on  the  decomposition  method  follows  exactly  the 


steps  outlined  in  section  3-4.  However,  a  last  difficulty  might  arise 
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when  we  switch  from  one  improvement  subprogram  to  the  other,  be- 

2  _ 2 

cause  the  matrix  B  corresponding  to  the  optimal  basis  B  of  sub- 

*  2 

program  a(t)  of  section  3-5  is  not  necessarily  nonsingular.  If  B 

is  singular,  then  the  first  step  to  be  taken  is  to  find,  by  column  per- 

2 

mutations  only,  a  nonsingular  B  .  To  do  this  we  can  again  conven¬ 
iently  use  Sherman-Morrison's  formula  [III-(40)J. 

To  conclude  this  discussion  we  now  give  a  summary  of  the  main 

2 

steps  of  the  improvement  subprogram  based  on  the  matrix  A  . 

Assumption.  We  start  with  a  feasible  basis  B  for  problem 
(11)  which  has  the  form  (14). 

Step  1.  Compute  and  if^. 

Step  2.  Set  up  the  coefficient  matrix  of  subproblem  (20). 

-2  2 

Step  3.  Compute  p  and  it  . 

Step  4.  Determine  ♦he  pi  .'Ot  column  A  .  (If  the  columns 

s 

price  out  nonnegative,  go  to  step  6.  ) 

2  1  —2  —2 

Step  5.  (i)  If  a  -  a  ,  introduce  A  into  B  and  return 

s 

to  step  3. 

2  1  1 
(ii)  If  a  >  a  ,  then  determine  a  new  B  by  using 

(24)  and  go  back  to  step  1. 


It  can  be  proved  that  there  exists  at  least  one  ordering  of  the 
columns  of  the  basi|  B  such  that  the  matrix  B,  given  by  (14),  has 
the  property  that  B  andB^  are  nonsingular.  However,  at  the  time  of 
the  writing  of  this  report  it  is  not  too  clear  to  the  author  whether  an 
attempt  should  be  made  to  keep  B  in  this  ideal  form  throughout  the 
simplex  steps  of  the  decomposition  method. 


1 
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Step  6.  Optimality  is  reached  for  this  improvement  subpro¬ 
gram.  If  the  basic  solution  has  not  been  improved 
by  this  subprogram,  then  optimality  has  been  reached 

for  the  original  problem.  If  it  has  been  improved, 

2 

find  a  matrix  B  which  is  nonsingular  and  go  to  the 
improvement  subprogram  based  on  . 

Remark.  This  algorithm  can  be  generalized  without  any  dif¬ 
ficulty  to  the  case  of  N- stage  problems. 
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